OpenAI's GA realtime API introduces significant WebRTC improvements including video support, better ICE negotiation with multiple endpoints, and streamlined session setup. The implementation uses H.264 for video encoding, processes video as snapshots rather than continuous streams, and maintains a clean architecture with host-only candidates and standard DTLS-SRTP encryption. Video analysis costs approximately 6.8 cents per image input, though pricing details remain unclear.
Table of contents
SummaryOffer/Answer NegotiationInteractive Connectivity Establishment (ICE) differencesFaster ICE negotiationNew Video supportHow does this compare to ChatGPT.com?12.7K Impressions