The Achilles’ Heel of LLM Inference Performance - Quantizing ActivationsTaming the Beast of Quantizations of ActivationsNov 6Nov 6
More than huggingface imports — LLM Internals Part -1A comprehensive guide to understanding the evolution of LLMs and the SOTA architectures with implementation details.Mar 7Mar 7
Unveiling the ‘G Factor’ in Language Models : A Leap Towards Understanding LM’S General…In the realm of artificial intelligence (AI), the quest to imbue machines with human-like intelligence has been a guiding star. Much like…Feb 3Feb 3
The AI Oppenheimer MetempsychosisRecently, I watched the movie Oppenheimer and the one thing that hit me hard was the current situation of the so-called “Artificial…Aug 15, 2023Aug 15, 2023
AI Explanation Mining — My Thesis AnecdoteRecently, I finished my Master’s thesis which subsides in the domain of AI explanation alignment. There is already work on AI alignment…Nov 2, 2022Nov 2, 2022
Why AI has an “A”? Dark Matter of Intelligence— Missing General Human Intelligence MatterWhile the question that needs to sit on the top of the mountain of the Human parallel intelligence research community is how and when…Nov 16, 2021Nov 16, 2021
Artificial General Attention EconomicsAn explanation to the ECAN, which proposes a dynamic attention architecture defined in the OpenCog system.Sep 5, 2021Sep 5, 2021