Goalposts

My litmus test question for LLMs is about negative mutual information. Its a weird quirk of probability theory where pairwise variables always have non-negative MI, but a set of three variables can have negative MI.

Its both a non-intuitive result and one where there is a tooon of text about pairwise MI and little about negative MI.

So far, nothing has passed the test.