Note: I had stopped writing posts in 2017. Slowly getting back into it in 2024, mostly for AI.
Large Language Models (LLMs) like ChatGPT can handle two aspects of communication very well: plausibility and fluency. Given an input context they determine what are the most probable sequence of words and string them in a way that is superbly eloquent. That makes the...
A few months ago my curiosity around how-are-LLMs-'learning' took me down the rabbit hole of AI and Psychology history and I ended up finding a string of very interesting and related developments from the last 120 years: 1905: Harvard-graduate psychologist Edward L....
The first 10 minutes of this Stanford CS224N lecture explained NLU, NLG and the tasks within and it was helpful. Natural Language Understanding (NLU) is a subset of NLP (processing), which uses syntactic and semantic analysis of text and speech to determine the...
As explained in this Stanford CS50 tech talk, Language Models (LMs) are basically a probability distribution over some vocabulary. For every word we give an LM, it can determine what the most probable word to come after that. It's trained to predict the Nth word,...
This seemed like the core ideas so I wanted to clarify them conceptually. "Embeddings" emphasizes the notion of representing data in a meaningful and structured way, while "vectors" refers to the numerical representation itself. 'Vector embeddings' is a way to...
I recently heard Jeff Bezos briefly talk about his views on LLMs here. Less than a minute into the conversation, he said something that struck a chord with me: LLMs in their current form are not inventions, they are discoveries. He followed that up with "we are...
Service industries like consulting, hospitality, restaurants or the local car mechanic, are judged on experience. Healthcare folks would like to think that it's all about outcomes but no one would argue that experience is just as important. And most healthcare...
Virta burst on to the digital health scene recently boasting a $37M funding round and a tech-heavyweight CEO Sami Inkinen who previously co-founded Trulia, the online real-estate platform. Virta is the latest digital health star to follow the trend of what I'm now...
Switzerland-based MindMaze created news early 2016 when it raised a $100 million round of funding at a pre-money valuation of a Billion dollars. It is creating virtual reality products related to neural recovery. The medical-grade product (!imaginatively called...
The service transaction between a patient and physician has always been looked at closely from a billing perspective. Relatively few attempts have been made to enhance the match-making aspect of it: like which physician is best suited for the given patient? Tweaking...