Note: I had stopped writing posts in 2017. Slowly getting back into it in 2024, mostly for AI.

Three simple examples of LLM confabulations

Large Language Models (LLMs) like ChatGPT can handle two aspects of communication very well: plausibility and fluency. Given an input context they determine what are the most probable sequence of words and string them in a way that is superbly eloquent. That makes the...

read more

NLG and the range of tasks within it

The first 10 minutes of this Stanford CS224N lecture explained NLU, NLG and the tasks within and it was helpful. Natural Language Understanding (NLU) is a subset of NLP (processing), which uses syntactic and semantic analysis of text and speech to determine the...

read more

Language Models and GPT’s evolution

As explained in this Stanford CS50 tech talk, Language Models (LMs) are basically a probability distribution over some vocabulary. For every word we give an LM, it can determine what the most probable word to come after that. It's trained to predict the Nth word,...

read more

Vector embeddings

This seemed like the core ideas so I wanted to clarify them conceptually. "Embeddings" emphasizes the notion of representing data in a meaningful and structured way, while "vectors" refers to the numerical representation itself. 'Vector embeddings' is a way to...

read more

When LLM experts say “We don’t’ know how”

I recently heard Jeff Bezos briefly talk about his views on LLMs here. Less than a minute into the conversation, he said something that struck a chord with me: LLMs in their current form are not inventions, they are discoveries. He followed that up with "we are...

read more

Docent Health

Service industries like consulting, hospitality, restaurants or the local car mechanic, are judged on experience. Healthcare folks would like to think that it's all about outcomes but no one would argue that experience is just as important. And most healthcare...

read more

Virta Health

Virta burst on to the digital health scene recently boasting a $37M funding round and a tech-heavyweight CEO Sami Inkinen who previously co-founded Trulia, the online real-estate platform. Virta is the latest digital health star to follow the trend of what I'm now...

read more

MindMaze

Switzerland-based MindMaze created news early 2016 when it raised a $100 million round of funding at a pre-money valuation of a Billion dollars. It is creating virtual reality products related to neural recovery. The medical-grade product (!imaginatively called...

read more