--- title: LiteLLM Has Some Serious Issues in Production | daily.dev description: LiteLLM faces production issues including 3+ second cold starts from loading all provider SDKs, performance degradation at 400-500 RPS with P99 latency... canonical: https://daily.dev/posts/litellm-has-some-serious-issues-in-production-pfquuaaxr twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: LiteLLM Has Some Serious Issues in Production | daily.dev og:description: LiteLLM faces production issues including 3+ second cold starts from loading all provider SDKs, performance degradation at 400-500 RPS with P99 latency... og:url: https://daily.dev/posts/litellm-has-some-serious-issues-in-production-pfquuaaxr og:image: https://api.daily.dev/og/posts/PfQuUAaxr.png og:image:alt: LiteLLM Has Some Serious Issues in Production og:image:width: 1200 og:image:height: 630 og:locale: en --- [AI Engineering](https://daily.dev/squads/ai%5Fengineers) [](https://daily.dev/kuldeeppaul27)[Kuldeep Paul @kuldeeppaul27 • Jan 2290](https://daily.dev/kuldeeppaul27) # LiteLLM Has Some Serious Issues in Production [](https://media.daily.dev/image/upload/s--qhj1TZdh--/f%5Fauto/v1769071664/posts/PfQuUAaxr?%5Fa=BAMAMiiu0) Comment Bookmark Copy Share your thoughts Post Share this post [](https://daily.dev/kuldeeppaul27) [Kuldeep Paul](https://daily.dev/kuldeeppaul27) [@kuldeeppaul27](https://daily.dev/kuldeeppaul27) Joined May 13\. 2025 90 #### Would you recommend this post? Copy link Slack WhatsApp Facebook X New Squad Copy linkShare with your friends ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"DiscussionForumPosting","mainEntityOfPage":"https://daily.dev/posts/litellm-has-some-serious-issues-in-production-pfquuaaxr","headline":"LiteLLM Has Some Serious Issues in Production","text":"LiteLLM faces production issues including 3+ second cold starts from loading all provider SDKs, performance degradation at 400-500 RPS with P99 latency reaching 90+ seconds, 350-400MB memory usage, a 5,500-line main.py file with global state, and breaking changes in minor updates. Bifrost, a Go-based alternative, reportedly delivers 54x faster P99 latency, zero cold starts, consistent performance at 1,000 RPS, and 120MB memory footprint.","url":"https://daily.dev/posts/litellm-has-some-serious-issues-in-production-pfquuaaxr","datePublished":"2026-01-22T08:47:43.717Z","dateModified":"2026-01-29T07:26:11.535Z","author":{"@type":"Person","name":"Kuldeep Paul","url":"https://daily.dev/kuldeeppaul27","image":"https://lh3.googleusercontent.com/a/ACg8ocJFEPn-pqwhXxqwm9ubzIjsQsO1yUD81jEzHR85et9mCjdyPI0=s96-c","interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"EndorseAction"},"userInteractionCount":90}},"image":"https://media.daily.dev/image/upload/s--qhj1TZdh--/f_auto/v1769071664/posts/PfQuUAaxr?_a=BAMAMiiu0","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"isPartOf":{"@type":"WebPage","url":"https://daily.dev/squads/ai_engineers","name":"AI Engineering"}} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"AI Engineering","item":"https://daily.dev/squads/ai_engineers"},{"@type":"ListItem","position":3,"name":"LiteLLM Has Some Serious Issues in Production"}]} ```