Skip to content

Commit

Permalink
add storage for lesson 8 and update README
Browse files Browse the repository at this point in the history
  • Loading branch information
@onlyphantom
onlyphantom committed May 14, 2023
1 parent e65b810 commit 4df93c2
Show file tree
Hide file tree
Showing 4 changed files with 19 additions and 6 deletions.
22 changes: 16 additions & 6 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,12 +5,18 @@ A set of instructional materials, code samples and Python scripts featuring LLMs
![LangChain youtube tutorials](assets/llmseries.png)

Learn LangChain from my YouTube channel:
- Part 1: [LangChain + OpenAI tutorial: Building a Q&A system w/ own text data](https://youtu.be/DYOU_Z0hAwo)
- Part 2: [LangChain + OpenAI to chat w/ (query) own Database / CSV](https://youtu.be/Fz0WJWzfNPI)
- Part 3: [LangChain + HuggingFace's Inference API (no OpenAI credits required!)](https://youtu.be/dD_xNmePdd0)
- Part 4: [Understanding Embeddings in LLMs](https://youtu.be/6uyBc0jm1xQ)
- Part 5: [Query any website with LLamaIndex + GPT3 (ft. Chromadb, Trafilatura)](https://youtu.be/6K1lyyzpxtk)
- Part 6: [Locally-hosted, offline LLM w/LlamaIndex + OPT (open source, instruction-tuning LLM)](https://youtu.be/qAvHs6UNb2k)

| Part | LLM Tutorial | Link | Video Duration |
| --- | --- | --- | --- |
| 1 | LangChain + OpenAI tutorial: Building a Q&A system w/ own text data | [Tutorial Video](https://youtu.be/DYOU_Z0hAwo) | 20:00 |
| 2 | LangChain + OpenAI to chat w/ (query) own Database / CSV | [Tutorial Video](https://youtu.be/Fz0WJWzfNPI) | 19:30 |
| 3 | LangChain + HuggingFace's Inference API (no OpenAI credits required!) | [Tutorial Video](https://youtu.be/dD_xNmePdd0) | 24: 36 |
| 4 | Understanding Embeddings in LLMs | [Tutorial Video](https://youtu.be/6uyBc0jm1xQ) | 29:22 |
| 5 | Query any website with LLamaIndex + GPT3 (ft. Chromadb, Trafilatura) | [Tutorial Video](https://youtu.be/6K1lyyzpxtk) | 11:11 |
| 6 | Locally-hosted, offline LLM w/LlamaIndex + OPT (open source, instruction-tuning LLM) | [Tutorial Video](https://youtu.be/qAvHs6UNb2k) | 32:27 |
| 7 | Building an AI Language Tutor: Pinecone + LlamaIndex + GPT-3 + BeautifulSoup | [Tutorial Video](https://youtu.be/k8G1EDZgF1E) | 51:08 |

The full lesson playlist can be found [here](https://www.youtube.com/playlist?list=PLXsFtK46HZxUQERRbOmuGoqbMD-KWLkOS).

### Side Lessons (good supplements to the main series above)
- [OpenAI tutorial and video walkthrough](https://youtu.be/skw-togjY7Q)
Expand All @@ -31,3 +37,7 @@ PINECONE_API_KEY=your_api_key_here
```
HuggingFace and Pinecone are optional but is recommended if you want to use the Inference API and explore those models outside of the OpenAI ecosystem. This is demonstrated in Part 3 of the tutorial series.
5. Run the examples in any order you want. For example, `python 6_team.py` will run the website Q&A example, which uses GPT-3 to answer questions about a company and the team of people working at Supertype.ai. Watch the corresponding video to follow along each of the examples.

### Dependencies
As LlamaIndex and LangChain are both very new projects, if you're using the latest version of these libraries, some of the code in this repo may need small adjustment. I will try to keep this repo up to date with the latest version of the libraries, but if you encounter any issues, please let me know. The code examples are tested on LlamaIndex 0.5.7 and LangChain 0.0.157.

1 change: 1 addition & 0 deletions storage/docstore.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"docstore/data": {"a13f5b58-e8e7-4a24-ab27-a360103375f1": {"__data__": {"text": " Date | Highlight | Fluent | DL w Pytorch | dbt Fundamentals | \n|-------|-----------|---------------|------------------------|----------------------|\n| 1 Feb |Send CBN proposals; Work from Djournal Cafe, Toastbox|254|58|0\n| 2 Feb |Return from jakarta; training w/SparkBeyond; meeting Irvin (haruplate) and Rio|258|77|0 \n| 3 Feb |Algoritma townhall, meeting w/Lita, supertype sync|258|80|0\n| 4 Feb |David and Hussain visits, build Fellowship's earn history feature|258|85|0\n| 5 Feb |Start dbt Fundamentals, ate at Gaya Minahasa|258|109|12\n| 6 Feb |Develop Fellowship, Forbes Tech Council|258|117|12\n| 7 Feb |Meeting w/Haruplate, send TOS, review Wilsen's article|258|121|12\n| 8 Feb |Publish technicalwriting.md, Develop Fellowship github binding|258|124|12\n| 9 Feb |Implement profileBox & specialCollections in Fellowship|258|124|12\n| 10 Feb |\u27a1\ufe0fJakarta, meet Timotius & Gerald for lunch|258|124|12\n| 11 Feb |Tira goes westlife, send proposal for BCA blockchain|258|124|12\n| 12 Feb |Learn dbt|259|124|31\n| 13 Feb |Complete dbt fundamentals; edit Gerald's article; work: Fellowship post-verification flow|259|124|65\n| 14 Feb |Refactor collection cards, work on Dependency idea|259|124|E\n| 15 Feb |Implement Prerequisite on Fellowship|259|124|E\n| 16 Feb |Meeting HaruPlate, develop PaymentBox|259|124|E\n| 17 Feb |Develop Payment Box, UX enhancements, screw up and fixed algoritma's transition to php8|259|124|E\n| 18 Feb |\ud83c\udf82 Birth of Supertype Collective|259|124|E\n| 19 Feb |Read DL w PyTorch because wifi unavailable|275|153|E\n| 20 Feb |Troubleshoot Strapi-Stripe payment extension; add /p/samuel on Collective|275|153|E\n| 21 Feb |\ud83c\udf82 Birth of [[wordpress-posts-react]]; edit Gerald's cloud infrastructure pdf|275|153|E\n| 22 Feb |Implement NextJs useStaticProp for Collective; create TopRow component; Update [[wordpress-posts-react]] |275|153|E\n| 23 Feb |Implement IconRow and Affiliations for Collective|275|153|E\n| 24 Feb |Implement Header and Footer, Head tag for Collective|275|153|E\n| 25 Feb |Start working at 0540, complete PRChecking flow in Fellowship|275|153|E\n| 26 Feb |\ud83c\udf82 Birth of Supertype Incubator; Create PDF export function in Collective|275|153|E\n| 27 Feb |Fix Supertype website; Fix Collective on light-mode & firefox; Add wiki, teach RM @algoritma|275|153|E\n| 28 Feb |Publish Optimized Analytics 1, fix Supertype website, write challenge wiki, Teach RM @algoritma|275|153|E", "doc_id": "a13f5b58-e8e7-4a24-ab27-a360103375f1", "embedding": null, "doc_hash": "511962f6a72b5d2ef0bc3a862f85e13165970230f96977bcca7be0efca7a4361", "extra_info": null, "node_info": {"start": 0, "end": 2386}, "relationships": {"1": "14728931-3883-41d2-a46e-45e2d181a1f8"}}, "__type__": "1"}, "908d1342-ee9c-4fe0-b875-facdbf3bab60": {"__data__": {"text": " Date | Highlight | Fluent | DL w Pytorch | Collections | \n|-------|-----------|---------------|------------------------|----------------------|\n| 1 May |Clean up youtube-api-python|275|153|3 \n| 2 May |Tutor Nurit; work a bit more on youtube-api-python|275|153|3 \n| 3 May |Added Vito profile; Chat with Felicia Haliman|275|153|3 \n| 4 May |Call with Jon; Tutor Nurit; add 3 collective projects|275|153|3 \n| 5 May |Tutor Queen, start work on Nietzsche; \ud83c\udf82 Birth of Summary|275|153|3 \n| 6 May |Script AI tutor example|275|153|3 \n| 7 May |Edit and Upload AI tutor video|275|153|3 \n| 8 May ||275|153|3 \n| 9 May ||275|153|3 \n| 10 May||275|153|3 \n| 11 May||275|153|3 ", "doc_id": "908d1342-ee9c-4fe0-b875-facdbf3bab60", "embedding": null, "doc_hash": "123b97f7e123c16224c51dbccbe413e34cfcd469452b14f91dec0017d8e33eb3", "extra_info": null, "node_info": {"start": 0, "end": 660}, "relationships": {"1": "1c365a5e-8edb-47da-8988-c8bd16a5e880"}}, "__type__": "1"}, "28f57f91-e52d-4d87-918d-ea4cdb2f5249": {"__data__": {"text": " Date | Highlight | Fluent | DL w Pytorch | Collections | \n|-------|-----------|---------------|------------------------|----------------------|\n| 1 Mar |Teach RM @algoritma, published optimized analytics 1, add points filter on Fellowship|275|153|3 \n| 2 Mar |Teach RM @algoritma, make Nominate page, merge discover branch, meet / bu Nona (BCA), meet Sara|275|153|E\n| 3 Mar |Code Collective Nominate page|275|153|E\n| 4 Mar |Refactor Nominate into multipage using react hook form|275|153|E\n| 5 Mar |Refactor Nominate moving nonpages out and build Affiliates page|275|153|E\n| 6 Mar |Complete Affiliates page and create NominationComplete page; create Supabase project|275|153|E\n| 7 Mar |Complete postToSupabase implementation, publish optimized analytics 2|275|153|E\n| 8 Mar |Meeting haruplate; add BuildReal section on Fellowship|275|153|E\n| 9 Mar |\u27a1\ufe0fJakarta; add animation to Fellowship|275|153|E\n| 10 Mar |Sleep deprived from waking up at 2pm, add GitHub OAuth, chat with yehezgun|275|153|E\n| 11 Mar |Fix OAuth flow on Collective, create npm organization, accidentally nuked my npm account|275|153|E\n| 12 Mar |Took Tira out to Guilliani, work on GitHub flow in nominate, republish npm packages|275|153|E\n| 13 Mar |Implement superinference in signup, add CTA on devprofile|275|153|E\n| 14 Mar |Work on Homepage for Collective|275|153|E\n| 15 Mar |Shipped Homepage for Collective|275|153|E\n| 16 Mar |\ud83c\udf82 Birth of Supertype Umai|275|153|E\n| 17 Mar |Start working on Executives Profile creation|275|153|E\n| 18 Mar |Add linkedin autho to Executives Profile|275|153|E\n| 19 Mar |Richer suggestions for profile tags w/ Superinference, add superinference to devprofile|275|153|E\n| 20 Mar |Talk to Ahmad and Farid on Supertype UK, improve FellowshipBot|275|153|E\n| 21 Mar |Add React-Query and create badges under avatar|275|153|E\n| 22 Mar |Eat @Dakiba, build Wordpress.com blog feature and authenticated btn|275|153|E\n| 23 Mar |Add \ud83c\udf19 mode to Collective, add github projects to Collective|275|153|E\n| 24 Mar |Add open source contributions to Collective|275|153|E\n| 25 Mar |Add contact card to Collective|275|153|E\n| 26 Mar |Add autoColumnLayout refactor and EnquiryModal|275|153|E\n| 27 Mar |Add LoginModal for PDF and image preview|275|153|E\n| 28 Mar |Better modal for Collective, chat with Nayoko|275|153|E\n| 29 Mar |Rewrite better layout engine for Collective|275|153|E\n| 30 Mar |Rewrite badges logic, dynamically hide empty components, tag_aggregate in db|275|153|E\n| 31 Mar |Explored top followers count, aesthetic refactor, add projects table|275|153|E\n-> move to [[apr2023]]", "doc_id": "28f57f91-e52d-4d87-918d-ea4cdb2f5249", "embedding": null, "doc_hash": "63ad781a941604b0648f6a9df08d8d37fbda0f53d5513cd05696ab50e748479c", "extra_info": null, "node_info": {"start": 0, "end": 2567}, "relationships": {"1": "debd4eb2-a825-49b0-9d7b-0ff70141cd96"}}, "__type__": "1"}, "8bd2a45a-977e-421f-bbb4-211710d828b2": {"__data__": {"text": " Date | Highlight | Fluent | DL w Pytorch | Collections | \n|-------|-----------|---------------|------------------------|----------------------|\n| 1 Apr |API for followers percentile|275|153|3 \n| 2 Apr |Walk to Taman Budaya w/Tira for cake & dinner|275|153|3 \n| 3 Apr |Complete PercentileBadge; Work on tag pages|275|153|3 \n| 4 Apr |Pushed to summary-frontend; Create tag pages|275|153|3 \n| 5 Apr |\u27a1\ufe0fJakarta|275|153|3 \n| 6 Apr |Clean keyboard; Build out llm-python|275|153|3 \n| 7 Apr |Publish LangChain 0 tutorial video|275|153|3 \n| 8 Apr |Sick|275|153|3 \n| 9 Apr |Eat at Giulliani and dessert day at Aeon. Play PocketCity2 with Tira|275|153|3 \n| 10 Apr|Record LangChain 1 tutorial|275|153|3 \n| 11 Apr|Uploaded LangChain 1 tutorial, Record LangChain 2 tutorial|275|153|3 \n| 12 Apr|Functional Navbar, merged /edit|275|153|3 \n| 13 Apr|Add popular tags to Collective, add Noels profile|275|153|3 \n| 14 Apr|Present scope to ABL Commercial, Mentor Sara|275|153|3 \n| 15 Apr|Record and Edit LangChain 4 tutorial|275|153|3 \n| 16 Apr|Record LangChain 5 tutorial|275|153|3 \n| 17 Apr|Published LangChain 5 tutorial; Eat at Pancar Garden|275|153|3 \n| 18 Apr|Improved tags page|275|153|3 \n| 19 Apr|Creat projects page and added first project entry in db|275|153|3 \n| 20 Apr|Add Testimonials section to Fellowship|275|153|3 \n| 21 Apr|Add spek testimonial, clean up drive, create local llm demo script|275|153|3 \n| 22 Apr|Ate at Giulliani for Eid Mubarak|275|153|3 \n| 23 Apr|Code up Project page on Collective|275|153|3 \n| 24 Apr|Script and prepare LangChain 6|275|153|3 \n| 25 Apr|Record and Edit LangChain 6 tutorial|275|153|3 \n| 26 Apr|Ate at Sushi Tei for dinner|275|153|3 \n| 27 Apr|Complete Project Page|275|153|3 \n| 28 Apr|Better projects page, first run up Siliwangi|275|153|3 \n| 29 Apr|Brought in Vito, add 2 projects into collective db|275|153|3 \n| 30 Apr|Recorded OpenAI python tutorial, talk to Nurit|275|153|3 ", "doc_id": "8bd2a45a-977e-421f-bbb4-211710d828b2", "embedding": null, "doc_hash": "9de4367b80e38cc16a55bae4331e53fbc68cb1adc0f2bf3734938059a2536582", "extra_info": null, "node_info": {"start": 0, "end": 1907}, "relationships": {"1": "95b4fbb7-6665-4f51-b1e7-511c201a40df"}}, "__type__": "1"}, "513fd6b2-839d-4b2c-ac59-d2eb2f53466b": {"__data__": {"text": " Date | Highlight | Fluent | DL w Pytorch | Computers |\n|-------|-----------|---------------|------------------------|----------------------|\n| 1 Jan | Beginning of a new year! | 74 | 18 | 0 |\n| 2 Jan | Start Python quiz for the company | 90 | 18 | 0 |\n| 3 Jan | Sick | 90 | 18 | 0 |\n| 5 Jan | Recovering | 98 | 18 | 0 |\n| 6 Jan | Fluent Python, typing practice | 101 | 18 | 0 |\n| 7 Jan | Bought Anthurium Magnificum Verde| 111 | 18 | 0 |\n| 8 Jan | First Sunday morning | 115 | 18 | 0|\n| 9 Jan | Updated website menu; meeting amt|115|18|0\n| 10 Jan | Fluent Python|136|18|0\n| 11 Jan | \u27a1\ufe0f Jakarta, meet Asian Bulk Logistik|136|18|0\n| 12 Jan | Better menu on Supertype, add creadits case study|136|18|0\n| 13 Jan | Edit & publish gerald's article|157|18|0\n| 14 Jan | Workout at 7|185|18|0\n| 15 Jan | Nayoko & Mulia visits|195|18|0\n| 16 Jan | Code on Fellowship|195|18|0\n| 17 Jan | GIN Austria, code on Fellowship|195|18|0\n| 18 Jan | Technical meeting: Enterprise Analytics Summit, MSW meeting|195|18|0\n| 19 Jan | Adaro meeting, code on Fellowship|195|18|2\n| 20 Jan | Enterprise Analytics|195|18|2\n| 21 Jan | Add timeline to Fellowship|195|18|7\n| 22 Jan | Ate at Giuliani Ristorante w/Cindy and Bellina|195|18|7\n| 23 Jan | Create Tools of the Trade:ecommerce|195|18|11\n| 24 Jan | Onboard Patrick, made Consulting deck v1|211|18|13\n| 25 Jan | Interview Wilsen, start builing Timeline feature for Fellowship|216|18|E\n| 26 Jan | Start building Scoreboard feature for Fellowship|218|18|E\n| 27 Jan | Build Target feature for Fellowship|225|18|E\n| 28 Jan | Ririn visits|235|18|E\n| 29 Jan | Meets Milestone for Fluent P; plan for feb2023|254|53|E\n| 30 Jan | Performance Review Fiqey; Publish torchvision0 |254|53|E\n| 31 Jan | \u27a1\ufe0f Jakarta, meet Adaro and CBN|254|53|E", "doc_id": "513fd6b2-839d-4b2c-ac59-d2eb2f53466b", "embedding": null, "doc_hash": "b733f0c3da31c19895cd58604b829accd4b4353e85c16d1033322ca68f8dcdfe", "extra_info": null, "node_info": {"start": 0, "end": 2077}, "relationships": {"1": "0773d992-bc4c-4731-9b1f-408d8cd0fac9"}}, "__type__": "1"}}, "docstore/metadata": {"a13f5b58-e8e7-4a24-ab27-a360103375f1": {"doc_hash": "511962f6a72b5d2ef0bc3a862f85e13165970230f96977bcca7be0efca7a4361"}, "908d1342-ee9c-4fe0-b875-facdbf3bab60": {"doc_hash": "123b97f7e123c16224c51dbccbe413e34cfcd469452b14f91dec0017d8e33eb3"}, "28f57f91-e52d-4d87-918d-ea4cdb2f5249": {"doc_hash": "63ad781a941604b0648f6a9df08d8d37fbda0f53d5513cd05696ab50e748479c"}, "8bd2a45a-977e-421f-bbb4-211710d828b2": {"doc_hash": "9de4367b80e38cc16a55bae4331e53fbc68cb1adc0f2bf3734938059a2536582"}, "513fd6b2-839d-4b2c-ac59-d2eb2f53466b": {"doc_hash": "b733f0c3da31c19895cd58604b829accd4b4353e85c16d1033322ca68f8dcdfe"}}}
1 change: 1 addition & 0 deletions storage/index_store.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"index_store/data": {"ed7dcc89-0707-47fb-8306-8031ef27bc31": {"__type__": "vector_store", "__data__": {"index_id": "ed7dcc89-0707-47fb-8306-8031ef27bc31", "summary": null, "nodes_dict": {"a13f5b58-e8e7-4a24-ab27-a360103375f1": "a13f5b58-e8e7-4a24-ab27-a360103375f1", "908d1342-ee9c-4fe0-b875-facdbf3bab60": "908d1342-ee9c-4fe0-b875-facdbf3bab60", "28f57f91-e52d-4d87-918d-ea4cdb2f5249": "28f57f91-e52d-4d87-918d-ea4cdb2f5249", "8bd2a45a-977e-421f-bbb4-211710d828b2": "8bd2a45a-977e-421f-bbb4-211710d828b2", "513fd6b2-839d-4b2c-ac59-d2eb2f53466b": "513fd6b2-839d-4b2c-ac59-d2eb2f53466b"}, "doc_id_dict": {"14728931-3883-41d2-a46e-45e2d181a1f8": ["a13f5b58-e8e7-4a24-ab27-a360103375f1"], "1c365a5e-8edb-47da-8988-c8bd16a5e880": ["908d1342-ee9c-4fe0-b875-facdbf3bab60"], "debd4eb2-a825-49b0-9d7b-0ff70141cd96": ["28f57f91-e52d-4d87-918d-ea4cdb2f5249"], "95b4fbb7-6665-4f51-b1e7-511c201a40df": ["8bd2a45a-977e-421f-bbb4-211710d828b2"], "0773d992-bc4c-4731-9b1f-408d8cd0fac9": ["513fd6b2-839d-4b2c-ac59-d2eb2f53466b"]}, "embeddings_dict": {}}}}}
1 change: 1 addition & 0 deletions storage/vector_store.json
View file

Large diffs are not rendered by default.

0 comments on commit 4df93c2

Please sign in to comment.