Sunday, April 28, 2024

Thursday, April 11, 2024

AI: algorithms


K-Means clustering [can be expensive]

- elbow method - calc how many clusters, but can be expsensive

alt: DBSCAN which calculates how many clusters to use (density-based clustering non-parametric algorithm)

https://en.wikipedia.org/wiki/DBSCAN



Tuesday, April 9, 2024

books read by Jordan Peterson

the parasitic mind

return of the god hypothesis

the myth of mental illness

factfulness

east of eden

the madness of crowds

the rational optimist

an anthropologist on mars


Wednesday, March 20, 2024

AI: LLMs and projects

Web element detection

OpenDILabCommunity/webpage_element_detection · Hugging Face


Layout parser - doc ingester

https://layout-parser.github.io/




Data generation - Langchain


DistilBERT: Faster version of BERT


DBRX - a 'mixture of experts' LLM


Hermes-2 Mistral 7B - good for "Function Calling" (so LLM delegates creating/modifying an app, to the client)


multimodal LLMs
HPT 1.5 Air: A New Open-Sourced 8B Multimodal LLM with Llama 3


Datasets - Roboflow (like HuggingFace for data)

AWS Inferentia2 (inf2 AWS instances - cheaper than g5)

Prompt hacking and testing

Token counts - for cost estimates

LLM powered autonomous agents

Building a NN from scratch

Wednesday, March 6, 2024