News

Oracle Debuts Generative AI Cloud Service and Beta 'AI Agents'

• By David Ramel
• 02/08/2024

Oracle Corp. has launched a new generative AI cloud service. Oracle Cloud Infrastructure Generative AI is a fully managed service with an application programming interface designed to integrate large language models (LLMs) into various tasks, such as writing assistance and chat. Oracle also announced a beta service for AI Agents, tailored to work with company data for specific organizational tasks.

With this new cloud service, Oracle aims to enhance customer operations, marketing, sales, risk and legal processes, and strategy and finance monitoring through automation and advanced data analysis.

"Agents translate user queries into tasks that Generative AI components (search tool, document corpus, LLM, response generation, etc.) perform to answer the queries," said Greg Pavlik, SVP in Oracle's Cloud Infrastructure group, in a blog post. "The first in a series of OCI Generative AI Agents is a retrieval augmented generation (RAG) agent that complements the general knowledge of LLMs with internal data using OCI OpenSearch to provide contextually relevant answers. Users can now transparently access diverse enterprise data sets through natural language without the need for specialist skills or to know the data's format or storage location."

In its latest innovation, Oracle presents OCI Generative AI Agents, a beta service that customizes agents to act as miniaturized, specialized chatbots utilizing company data. These agents can perform tasks by translating user queries into actions, providing contextually relevant answers by harnessing internal data through OCI OpenSearch, Oracle says.

Oracle is also preparing to unveil OCI Data Science AI Quick Actions, a no-code feature that facilitates access to various open-source large language models. This feature promises a user-friendly interface, curated models, and streamlined fine-tuning and monitoring processes for deployment.

"OCI Data Science Quick Actions provides access to curated models that users can fine tune, evaluate, and deploy with their data, but also encompasses a comprehensive ecosystem with user-friendly workflows, integrated telemetry and visualizations, and simplified execution processes," Pavlik explained.

Oracle, like other cloud providers, is going all in on AI in order to gain market share. AI was widely credited with boosting the most recent quarterly financial results from the "Big 3" cloud giants and, according to brand-new Synergy Research Group data, is propelling cloud spending to new heights. As the following chart indicates, however, Oracle is at the bottom of that pack.

Trying to catch up, the company summarized upcoming AI enhancements to its various services thusly:

• Oracle Digital Assistant: Now allows you to incorporate data from LLMs along with your enterprise data into chat experiences. Oracle Digital Assistant combines database information, enterprise knowledge documents, and generative AI to enable natural language conversations with minimal effort. Developers can use generative AI capabilities to build digital assistants more quickly and efficiently.
• OCI Language: Adds healthcare insights with natural language processing. This new feature of the OCI Language service helps better process language in the medical domain. New models will help recognize medical terms, relationships and entities in records such as clinical trials notes, patient progress notes, and electronic health records.
• Document Translation Experience: Adds a new file-based document translation feature to support a wide range of formats -- Word, .PPT, HTML, JSON, and Excel -- helping to ensure that content remains intact and translated across diverse file types.
• OCI Vision: Adds Facial Detection, now with the ability to recognize faces and facial features in images, and expanding the number of OCI Vision use cases. Additionally, Vision will support file-based video processing.
• OCI Speech: Adds "diarization," allowing the service to embed speaker information into transcribed sections of audio. Diarization makes OCI Speech a valuable tool for organizing, analyzing, and extracting meaningful information from spoken interactions. Additionally, Speech will support real-time transcription and usage of open-source models such as Whisper.
• OCI Document Understanding: Support for over 300 additional languages and model improvements.
• OCI Data Science: Adds Feature Store, a central repository used to manage features developed by data science teams. Feature Store provides a cohesive framework where features are meticulously documented, shared, stored, and served in a streamlined manner. Also, a new Forecasting operator is available so customers can leverage Oracle's proprietary deep learning models through OCI Data Science with a no-code operator.

"With today's news, Oracle is bringing generative AI to customer workloads and their data -- not asking customers to move their data to a separate vector database," the company quoted IDC exec Ritu Jyoti as saying. "With a common architecture for generative AI that is being integrated across the Oracle ecosystem from its Autonomous Database to Fusion SaaS applications, Oracle is bringing generative AI to where exabytes of customer data already reside, both in cloud data centers and on-premises environments. This greatly simplifies the process for organizations to deploy generative AI with their existing business operations."