---
title: "How Good Are the Latest Open LLMs? And Is DPO Better Than PPO?"
url: https://daily.dev/posts/how-good-are-the-latest-open-llms-and-is-dpo-better-than-ppo--xexoypkfw
source_url: https://magazine.sebastianraschka.com/p/how-good-are-the-latest-open-llms
type: article
source: "Substack"
published: 2024-05-12T16:23:00.450Z
updated: 2024-05-12T16:22:57.305Z
tags: ["llm", "reinforcement-learning"]
reading_time: 24
upvotes: 4
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# How Good Are the Latest Open LLMs? And Is DPO Better Than PPO?

**[Substack](https://daily.dev/sources/substack)** · 24 min read · 4 upvotes · 0 comments

## Summary

The post discusses the latest open LLM releases including Mixtral 8x22B, Llama 3, Phi-3, and OpenELM. It also compares the performance of Mixtral 8x22B to other LLMs and explores the training data size for Llama 3. Additionally, it provides a comprehensive study on whether DPO is superior to PPO for LLM alignment.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://magazine.sebastianraschka.com/p/how-good-are-the-latest-open-llms>

## Similar posts on daily.dev

- [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 0 upvotes · 0 comments
- [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments
- [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments

---

Tags: [#llm](https://daily.dev/tags/llm), [#reinforcement-learning](https://daily.dev/tags/reinforcement-learning)

[View this post on daily.dev](https://daily.dev/posts/how-good-are-the-latest-open-llms-and-is-dpo-better-than-ppo--xexoypkfw)
