AI: LLMs, prompting, platforms (hardware) and projects

AI Papers, Books and Datasets

Learning Transferable Visual Models From Natural Language Supervision = 
https://arxiv.org/abs/2103.00020

-

Datasets

from AI Engineering:

Resources for Publicly Available Datasets

Here are a few resources where you can look for publicly available datasets. While you should take advantage of available data, you should never fully trust it. Data needs to be thoroughly inspected and validated.

Always check a dataset's license before using it. Try your best to understand where the data comes from. Even if a dataset has a license that allows commercial use, it's possible that part of it comes from a source that doesn't:

1. Hugging Face (https://oreil.ly/tlt5h) and Kaggle (https://oreil.ly/g8A4a) each host
   hundreds of thousands of datasets.
2. Google has a wonderful and underrated Dataset Search (https://oreil.ly/TgOaR).
3. Governments are often great providers of open data. Data.gov (https://data.gov) hosts hundreds of thousands of datasets, and data.gov.in (https://data.gov.in) hosts tens of thousands.
4. University of Michigan's Institute for Social Research (https://oreil.ly/VhVzp)
   ICPSR has data from tens of thousands of social studies.
5. UC Irvine's Machine Learning Repository (https://oreil.ly/jAR9e) and OpenML (https://oreil.ly/d-Yty) are two older dataset repositories, each hosting several thousand datasets.
6. The Open Data Network (https://oreil.ly/_tW6P) lets you search among tens of thousands of datasets.
7. Cloud service providers often host a small collection of open datasets; the most notable one is AWS's Open Data (https://oreil.ly/DZ5uV).
8. ML frameworks often have small pre-built datasets that you can load while using the framework, such as TensorFlow datasets (https://oreil.ly/HMJX_).
9. Some evaluation harness tools host evaluation benchmark datasets that are suff-ciently large for PEFT finetuning. For example, Eleuther AI's Im-evaluation-harness (https://github.com/EleutherAl/m-evaluation-harness) hosts 400+ benchmark datasets, averaging 2,000+ examples per dataset.

10. The Stanford Large Network Dataset Collection (hts://oreilye_B) is a great

repository for graph datasets.

Free Datasets

https://www.v7labs.com/blog/best-free-datasets-for-machine-learning

UI Modelling - annotated UIs

https://uimodeling.github.io/

Datasets - Roboflow (like HuggingFace for data)

https://public.roboflow.com/

Dataset - Anthropic use of AI by job category 

https://huggingface.co/datasets/Anthropic/EconomicIndex

-

MoE (Mixture of Experts)

LLM Mixture of Experts Explained (tensorops.ai)

An Introduction to Vision-Language Modeling

Vision AI - VLMs and CNNs
- Vision Language Models
- Convolutional Neural Networks

https://arxiv.org/pdf/2405.17247

Multi-modal LLMs

Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs (cambrian-mllm.github.io)

Movies: rated [for collaborative filtering]

MovieLens Latest Datasets | GroupLens

The Society of Mind

Book by Marvin Minsky

AI Engineering[Book] [O'Reilly] [Zeki recommends]

same author: Designing Machine Learning Systems- DMLS focuses on building applications on top of traditional ML models, which involves more tabular data annotations, feature engineering, and model training

LLM Engineer's Handbook [O'Reilly] by Paul Iusztin, Maxime Labonne

AI and ML for Coders in PyTorch: A Coder’s Guide to Generative AI and Machine Learning by Laurence Moroney is a practical, code-first resource for programmers eager to master modern machine learning and generative AI

Artificial Intelligence: A Modern Approach

gen-ai news and updates

 

LocalLLaMA - gen-ai on reddit

https://www.reddit.com/r/LocalLLaMA/

LLM Leaderboard - https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

Superintelligence

the beginning of infinity

The Business Case for AI: A Leader's Guide to AI Strategies, Best Practices & Real-World Applications

Book by Kavita Ganesan

- but neglects challenge of culture change and ethics

- profit vs ethics

'Bullshit' Detection rates

- BullshitBench: V2 (New) Viewer

.

history

The Decline and Fall of the Roman Empire

- by Edward Gibbon

Black Lamb and Grey Falcon

- by Rebecca West

- A Journey Through Yugoslavia is a travel book written by Dame Rebecca West, published in 1941 in two volumes

The Lessons of History

- by Will Durant

(on marmite as solution to Middle East crises - not marmalade?)

https://www.irishtimes.com/culture/books/edward-de-bono-obituary-lateral-thinker-who-proposed-marmite-as-solution-to-arab-israeli-conflict-1.4590539

- Edward de Bono

biography

 

Go Tell It on the Mountain

- James Baldwin

Jacobo Timerman: Prisoner Without a Name, Cell Without a Number

Julius Caesar and the Roman People

Book by Robert Morstein-Marx

Gerrit Van Gelderen: To the Waters and the Wild

(Dutch wildlife artist who was on RTE).

Spanish Classics (espanol)

 

https://youtu.be/XURU-AffUWc?si=OS1b4X5-QCq_Mavi

gothic - Stoker, M R James, H P Lovecraft, Shelley, Zofloya...

_________________________

Victorian Horror

Dracula's Brood: Neglected Vampire Classics by Sir Arthur Conan Doyle, Algernon Blackwood, M.R. James, Et. Al

- richard dalby

the black reaper - Bernard Capes

_____________________________

Lafcadio hearn

done - Japanese Ghost Stories [Penguin]

out of the east

in ghostly japan 

kokoro

shadowings

japanese goblin poetry

_____________________________

Le Fanu - 
Strange Event in the Life of Schalken the Painter
Uncle Silas
The House by the Churchyard
done - Carmilla

[have] Tess of d'ubervilles

_____________________________

Bram Stoker

[historical but not fully factual][inspired Bram Stoker] Foxe's Book of Martyrs

Something in the Blood - David J Skal (bio of Stoker)

Texts:

- The Lair of the White Worm [Bram Stoker, last book]

- The Jewel of the Seven Stars [Bram Stoker, his best written aside from Dracula]
- Under the Sunset - Book by Bram Stoker (for children?)

Best films:

1922 - Nosferatu

1933 - Bela Lugosi

1959 - Christopher Lee

_____________________________

[have] Bleak House (Dickens)


Arthur Conan Doyle - gothic tales

[mostly done] M R James:http://www.thin-ghost.org/

H P Lovecraft:
http://www.hplovecraft.com/writings/fiction/   

====
Halloween Books:


Gormenghast Trilogy by Mervyn Peake https://bit.ly/2SqaYQW
Veniss Underground by Jeff VanderMeer http://tinyurl.com/yydzbocp
A Peculiar Peril by Jeff VanderMeer https://bit.ly/3lbLR0M
In the Woods by Tana French https://bit.ly/3ndqEp1
Neverwhere by Neil Gaiman https://bit.ly/36t2FMD
Middlegame by Seanan McGuire https://bit.ly/3jnMiEF
White is for Witching by Helen Oyeyemi https://bit.ly/2GyTPC9
The Haunting of Hill House by Shirley Jackson https://bit.ly/3cXaJXi
Mexican Gothic by Silvia Moreno-Garcia https://bit.ly/3laiThB
Something Wicked This Way Comes by Ray Bradbury https://bit.ly/2GmLFgj
Perfume by Patrick Süskind https://bit.ly/2Gq0778
I’m Thinking of Ending Things by Iain Reid https://bit.ly/3n8nW3Y
The Bloody Chamber by Angela Carter https://bit.ly/36vENrE
The Strange Case of Dr. Jekyll and Mr. Hyde by Robert Louis Stevenson https://bit.ly/3cW9He7
The Woman in White by Wilkie Collins https://bit.ly/2Suv3Wd
Frankenstein by Mary Shelley https://bit.ly/2HThldI
Dracula by Bram Stoker https://bit.ly/30tT7x9
The Turn of the Screw by Henry James https://bit.ly/3imgpLq
Rebecca by Daphne du Maurier https://bit.ly/2EY2y0f
The Master and Margarita by Mikhail Bulgakov https://bit.ly/2Snhqs1
The Overstory by Richard Powers https://bit.ly/3nfKmQY
Solar Bones by Mike McCormack https://bit.ly/3lbu6hW
Morvern Callar by Alan Warner https://bit.ly/33wtuxH
Fingersmith by Sarah Waters https://bit.ly/3cUsGpf
The Fifth Season by N. K. Jemisin https://bit.ly/36w50Xc
Jonathan Strange & Mr Norell by Susanna Clarke https://bit.ly/30wGUrs
The Secret History by Donna Tartt https://bit.ly/34nrXJq
City of Saints & Madmen by Jeff VanderMeer https://bit.ly/3io8rkN

Rebecca Review: https://bit.ly/36vHjOM
Solar Bones Review: https://bit.ly/36qAePr
Fingersmith Review: https://bit.ly/30vphIG
The Fifth Season Review: https://bit.ly/3lnfCMj (BLOG)/ https://bit.ly/34omUbw (YT)
City of Saints and Madmen Review: https://bit.ly/34lMSML