Tree of Thoughts Explained From Foundations (LLMs Unhyped — 1)

“Programmers are, in their hearts, architects, and the first thing they want to do when they get to a site is to bulldoze the place flat and build something grand.” : Joel Spolsky, co-founder of Stack Overflow

Photo by Alina Grubnyak on Unsplash

Table of Contents

· Introduction
· What is the Tree of Thought?
· Why bother adding it to an LLM?
· Theoretical Background
∘ Chain of Thought
∘ Trees
∘ Traversing a Tree
∘ Ensemble Learning
· Tricking an LLM
∘ Prompts
∘ Ensemble
∘ Evaluation
∘ Immediate Shortcomings
∘ Perks
· Why “LLMs Unhyped”?
· Some more resources for you :)
· Fin

Introduction

Large language models like GPT4 have taken over the world and has left every second IT person to scramble towards the next great AI solution. Given the monetary benefits, a lot of research has popped up in a very short time. While this is very exciting, it is wise to look a little…