An open source Claude Artifacts – generate small apps with one prompt. Powered by Llama 3 405B & Together.ai.
## Tech stack - [Llama 3.1 405B](https://ai.meta.com/blog/meta-llama-3-1/) from Meta for the LLM - [Together AI](https://dub.sh/together-ai) for LLM inference - [Sandpack](https://sandpack.codesandbox.io/) for the code sandbox - Next.js app router with Tailwind - Helicone for observability - Plausible for website analytics ## Cloning & running 1. Clone the repo: `git clone https://github.com/Nutlope/llamacoder` 2. Create a `.env` file and add your [Together AI API key](https://dub.sh/together-ai): `TOGETHER_API_KEY=` 3. Run `npm install` and `npm run dev` to install dependencies and run locally ## Future Tasks - [ ] Look into a way to export/deploy the app in a single click. Can try extracting the codesandbox URL and displaying it to the user (check React docs) or can try to do it myself with a dynamic route + some hashing - [ ] Save previous versions so people can go back and forth between the generated ones - [ ] Add dark mode to the site overall, nice design change - [ ] Could be nice to show a "featured apps" sections on the site - [ ] Support more languages starting with Python, check out E2B - [ ] Try finetuning a smaller model on good prompts from 405b or GPT-4/Claude - [ ] Think about how to have 405B correct itself (sometimes it makes up imports) - [ ] New route for updateCode that only sends the latest generated code + the modify request - [ ] Fix bug where if a user edits the code, then does a change, it doesn't use the edited code - [ ] Add rate limiting with redis upstash if the traffic gets too high - [ ] Try to add a consistent component library like shadcn - [ ] Apply code diffs directly instead of asking the model to generate the code from scratch - [ ] Add the ability to upload things like a screenshot for it to start from that