🦚 Peacock Unified

βš™οΈ Tech Vault

Technical knowledge & experiments Β· 19,205 documents

IDDocumentSource
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• what one should i download Hugging Face's logo Hugging…/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ─ GEMINI: ─/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: GEMINI: /home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ── GEMINI: ──/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ═══ GEMINI: ═══/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• cmake --build . --config Release Error: could not load cache GEMINI: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• Aight, check it. "Error: could not load cache". That's CMake…/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ─ GEMINI: ─/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: GEMINI: /home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ── GEMINI: ──/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ═══ GEMINI: ═══/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• cd bin ls libggml-base.so llama-batched-bench llama-gemma3-cli llama-llava-cli llama-mtmd-cli llama-run llama-tts …/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ─ GEMINI: ─/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: GEMINI: /home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ── GEMINI: ──/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ═══ GEMINI: ═══/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• fuck i tried pasting somethign and the bot is responding back to me a long response then it finishes then the ext line of my paste is being sent then another…/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ─ GEMINI: ─/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: GEMINI: /home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ── GEMINI: ──/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ═══ GEMINI: ═══/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• i dont need tho expose it on that port just load it i am running a custom frontend on the runpod instance so i dont ened to do that GEMINI:…/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ─ GEMINI: ─/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: GEMINI: /home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ── GEMINI: ──/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ═══ GEMINI: ═══/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• im installing now on an a40 #!/usr/bin/env python3 # START ### IMPORTS ### import os import sys import re import shutil import json import argparse import…/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__04.29.25-copy.of.copy.of.copy.of.pythoUSER: ─ GEMINI: ─/home/flintx/ai-chats/aistudio/all-logs-clean/04.29.25-copy.of.copy.of.copy.of.p
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: GEMINI: /home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ── GEMINI: ──/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ═══ GEMINI: ═══/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• pip show litellm% flintx@flintx ξ‚° ~ ξ‚° ξ‚  master ξ‚° pip show litellm WARNING:…/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ─ GEMINI: ──/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: GEMINI: ═══/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ── GEMINI: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• Aight, I see that `docker ps -a` output, my boy. You ran the play to show all containers, and you ain't got a `litellm_proxy` listed, but you *do* got…/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ═══ GEMINI: ─/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• (venv) flintx@flintx ξ‚° ~/litellm ξ‚° ξ‚  main ξ‚° docker ps -a CONTAINER ID IMAGE COMMAND CREATED …/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ─ GEMINI: ──/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: GEMINI: ═══/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ── GEMINI: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• Aight, I see that `docker ps -a` again, my boy. Confirms `litellm_proxy` (ID `392fb3bc7ce5`) is still sittin' there exited with status `(3)`. We ran the…/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ═══ GEMINI: ─/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new Loaded config YAML (api_key and environment_variables are not shown): { "model_list": [ …/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ─ GEMINI: ═══/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: GEMINI: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• Aight, my boy, I see that output now. Looks like you pulled the build layers or history for the LiteLLM image (`ghcr.io/berriai/litellm:main-stable`). That…/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ── GEMINI: ─/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ═══ GEMINI: /home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• model_list: - model_name: llama2:latest # This is the name you'll use in your app/curl litellm_params: model: llama2:latest # This is the actual…/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ─ GEMINI: ═══/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: GEMINI: β•β•β•β•β•β•β•β•β•β•β€’βŠ±βœ¦βŠ°β€’β•β•β•β•β•β•β•β•β•β•β• Whoa, whoa, HOLD UP, my boy! Back the fuck up. You are absolutely right. Put that on everything, my bad. I got tunnel vision tryna fix the startup and the…/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ── GEMINI: ─/home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o
tech_vault__05.25.25-troubleshooting.litellm.ollamUSER: ═══ GEMINI: /home/flintx/ai-chats/aistudio/all-logs-clean/05.25.25-troubleshooting.litellm.o