As a world-leading AI research institution, OpenAI has launched several significant feature updates at DevDay 2024, aimed at promoting the application and development of artificial intelligence technology. The following is a professional introduction to the latest API features, visual updates, Prompt Caching, model distillation, the Canvas interface, and AI video generation technology released by OpenAI.
Realtime API
The introduction of the Realtime API provides developers with the possibility of rapidly integrating voice-to-voice functionality into applications. This integration consolidates the functions of transcription, text reasoning, and text-to-speech into a single API call, greatly simplifying the development process of voice assistants. Currently, the Realtime API is open to paid developers, with pricing for input and output text and audio set at $0.06 and $0.24 per minute, respectively.
Vision Updates
In the area of vision updates, OpenAI has announced that GPT-4o now supports image-based fine-tuning. This feature is expected to be provided for free with visual fine-tuning tokens before October 31, 2024, after which it will be priced based on token usage.
Prompt Caching
The new Prompt Caching feature allows developers to reduce costs and latency by reusing previously input tokens. For prompts exceeding 1,024 tokens, Prompt Caching will automatically apply and offer a 50% discount on input tokens.
Model Distillation
The model distillation feature allows the outputs of large models such as GPT-4o to be used to fine-tune smaller, more cost-effective models like GPT-4o mini. This feature is currently available for all developers free of charge until October 31, 2024, after which it will be priced according to standard rates.
Canvas Interface
The Canvas interface is a new project writing and coding interface that, when combined with ChatGPT, supports collaboration beyond basic dialogue. It allows for direct editing and feedback, similar to code reviews or proofreading edits. The Canvas is currently in the early testing phase and is planned for rapid development based on user feedback.
AI Video Generation Technology
OpenAI has also made significant progress in AI video generation with the introduction of innovative technologies such as Movie Gen, VidGen-2, and OpenFLUX, which have attracted widespread industry attention.
Conclusion
The release of OpenAI DevDay 2024 marks the continued innovation of the company in the field of AI technology. Through these updates, OpenAI has not only provided more efficient and cost-effective technical solutions but has also furthered the application of artificial intelligence across various domains. For developers, the introduction of these new features is undoubtedly expected to greatly enhance work efficiency and inspire more innovative possibilities.
Related Topic
Artificial Intelligence, Large Language Models, GenAI Product Interaction, RAG Model, ChatBOT, AI-Driven Menus/Function Buttons, IT System Integration, Knowledge Repository Collaboration, Information Trust Entrustment, Interaction Experience Design, Technological Language RAG, HaxiTAG Studio, Software Forward Compatibility Issues.