• Everyday AI
  • Posts
  • Maximize the Power of AI With Data Streaming

Maximize the Power of AI With Data Streaming

OpenAI closes $6.6B funding, Google to run ads in AI Overviews, U.S. to invest $100M in AI and more!

Author

Everyday AI
October 03, 2024

Outsmart The Future

Today in Everyday AI
7 minute read

🎙 Daily Podcast Episode: If you’re looking to make your AI faster and a better decision maker, streaming data might be your answer. We break down why that is. Give it a listen.

🕵️‍♂️ Fresh Finds: OpenAI releases new Canvas feature, Microsoft invests $4.8B in Italy, Amazon Fire tablets to include AI and xAI moves into OpenAI’s old HQ. Read on for Fresh Finds.

🗞 Byte Sized Daily AI News: OpenAI closes $6.6B funding, Microsoft Azure unveils AI supercomputing clusters and Google to start running ads in AI Overviews. For that and more, read on for Byte Sized News.

🚀 AI In 5: Microsoft Copilot just added new voice capabilities! Is it any good? We dive in to test it out. See it here

🧠 Learn & Leveraging AI: Looking to boost your AI speed and smarts? We explain how AI and streaming data can help you grow your company. Keep reading for that!

↩️ Don’t miss out: Did you miss our last newsletter? We talked about NVIDIA unveiling multimodal LLM, Google working on reasoning AI and OpenAI co-founder joining Anthropic. Check it here!

Maximize the Power of AI With Data Streaming 📊

Are you missing out on the power of streaming data?

Want to know how to make your AI faster, smarter, and more relevant?

Join us for a deep dive into how data streaming can transform AI from a predictive tool into a real-time decision-maker with Will LaForest, Global Field CTO of Confluent.

Join the conversation and ask Jordan and Will questions on AI and data streaming here.

Also on the pod today:

• Future of Data and AI 🔮
• Data Governance and Traceability 🕵
• Risks and Importance of Data Streaming 📁

It’ll be worth your 29 minutes:

Listen on our site:

Click to listen

Subscribe and listen on your favorite podcast platform

Listen on:

Here’s our favorite AI finds from across the web:

New AI Tool Spotlight – Buzzabout provides AI-driven audience insights, CostGPT generates software costs and features and Lookie is a faster way to learn on YouTube.

OpenAI – OpenAI has released Canvas, a new way to work with ChatGPT on writing and code.

Big Tech – Microsoft is investing $4.8 billion in Italy for AI infrastructure.

Google– Google is introducing XR-Objects, a new open-source augmented reality prototype.

Also from Google Labs, it released its competitor to NotebookLM.

LLMs– FLUX 1.1 is now available on Poe.

AI Tech – Amazon’s new Fire Tablets will include AI.

LLMs – Cohere has announced new fine-tuning features.

Trending in AI – Elon Musk’s xAI is moving into OpenAI’s old HQ.

AI in Media - The new PS55 Pro’s AI upscaling feature is causing buzz around its future.

AI Models - Google DeepMind says its AI designs chips better than humans but experts disagree.

AI Partnerships – Supermicro and Fujitsu are partnering to develop an AI-powered server.

1. OpenAI Closes Funding and Seeks Exclusive Investor Commitment 🤑

OpenAI has attracted a whopping $6.6 billion from major investors like Thrive Capital and Tiger Global, but there’s a catch: they want these backers to steer clear of five rival companies, including Anthropic and Elon Musk's xAI. This strategy highlights the fierce competition in the AI landscape as firms rush to develop large language models, crucial for future advancements.

While such requests are typical in venture capital, OpenAI's specific competitor list marks a unique approach in securing an edge. As OpenAI aims for a staggering revenue leap to $11.6 billion by 2025, this maneuver could reshape fundraising dynamics for both themselves and their rivals.

2. Azure Unveils Powerful AI Supercomputing Clusters 🧑‍💻️

Microsoft has launched its new Azure ND H200 v5 series virtual machines, specifically designed for high-performance AI workloads. These supercharged VMs boast impressive upgrades, including a 76% increase in High Bandwidth Memory, enabling faster access to model parameters and reduced latency for real-time applications.

Early tests indicate a significant 35% boost in throughput for generative AI tasks, making it an exciting prospect for businesses and researchers alike. As organizations look to innovate with AI, these advancements could be the key to unlocking groundbreaking solutions that elevate their competitive edge.

3. U.S. to Invest $100 Million in AI for Semiconductors 🇺🇸

The U.S. Commerce Department has announced a substantial investment of $100 million aimed at integrating artificial intelligence into the sustainable development of semiconductor materials. This initiative is part of a larger effort overseeing $52.7 billion designated for U.S. semiconductor manufacturing and research, with a focus on accelerating the creation of resource-efficient materials.

By fostering collaboration among universities, national labs, and private sectors, this funding is expected to streamline the development process and could significantly benefit tech companies and professionals looking to innovate in the semiconductor space.

4. Google Expands Gemini Live to New Languages 🗣

Google is rolling out Gemini Live in French, German, Portuguese, Hindi, and Spanish, just weeks after its initial launch in English. The tech giant promises that these languages will be available to all users in a couple of weeks, with aspirations to support over 40 languages soon after.

As the race for AI language services heats up, this expansion highlights Google's commitment to making AI more accessible and practical for users worldwide.

5. AI Alliance Takes on Cancer 🎗

Four leading cancer centers have united to form the Cancer AI Alliance (CAIA), backed by industry giants like AWS, Deloitte, Microsoft, and NVIDIA. With over $40 million in funding, this collaboration aims to harness the power of AI and vast cancer data to uncover new insights while prioritizing data security and compliance. Fred Hutch Cancer Center will lead the charge, tackling challenges around computational resources and data privacy that have long hindered cancer research.

As CAIA prepares to launch by the end of 2024, its ambitious goal of revolutionizing cancer treatment could significantly impact both patients and professionals in the healthcare sector.

6. Google To Introduce Ads in AI Overviews 🤔

Google is set to introduce advertisements within its AI Overviews, a feature that summarizes search queries with AI-generated insights. This rollout, which begins in the U.S., aims to monetize a service that has sparked controversy for its reliability, as it has struggled with accuracy in citing sources. As Google faces competition from platforms like ChatGPT and Perplexity, the integration of ads may provide quick access to relevant products and services but could also clutter the user experience.

A new study suggests that these changes might negatively impact about 25% of publisher traffic, raising concerns about the long-term effects on the digital content landscape.

Microsoft Copilot's new voice mode is here!

Microsoft just released its Copilot V2, its new and updated Copilot interface.

One new feature includes voice capabilities. We’re reviewing the voice feature and showing you how it works.

Is it any good?

Find out in today's AI in 5.

🦾How You Can Leverage:

If your data is a few hours old, it might as well be a few years old. 

Because fresh data is more than the new oil in our AI-first worlds. 

In an AI-first world where large language models have given all businesses superpowers, having the right data at the right time is the X factor that separates the winners from the losers. 

Wanna get left behind? Rely on a LLM’s training data, which is stupid old. 

Wanna get ahead? Get fresher data with data streaming. 

He’s the Global Field CTO at Confluent, a real-time data streaming platform and publicly traded company on pace to do about a billion in revenue this year.

(If you don’t know Confluent, they’re a pretty big deal in the data world. Their data streaming platform literally powers everything from your Domino’s order to OpenAI itself.) 

Will cut it to us straight —  data’s always been important. Structured data is what made traditional AI and machine learning so impactful over the past few decades. 

But, Generative AI has changed not just who can benefit from real-time data, but what it can even do. 

Because GenAI can make sense of the messy, unstructured data—emails, chats, documents—that traditional systems can’t handle, the concept of real-time data has become even more golden. 

Enter — data streaming. 

Because large language models are usually based on data that’s 6-18 months old. 

Which might as well be from the 90s. 

With data streaming, insights aren’t delayed—they happen as events unfold. Your data is always current, always actionable.

Ready to go to data school? 

Here’s the data dump you need to know. 👇

1 – Data is the missing LLM piece 📊

Was the Generative AI wave a dud? 

Shouldn’t the LLMs already be reading our minds and legit doing like 99% of our job and we just sip tea and begrudgingly approve of the work it completes? 

Not exactly. 

An overlooked fact of the do-it-all large language models like ChatGPT, Claude, Gemini and others? 

Their training data is older than that one tattered t-shirt you found in your mom’s attic. 

OK. Not actually. But most LLMs have a knowledge base or training data that is 6-12 months old. And that’s the BEST case. 

Try this: 

Will emphasized that's why real-time data streaming is crucial. Your company's up-to-the-second information needs to be fed into vector databases and processed into embeddings. 

These are then used in Retrieval Augmented Generation (RAG) to provide fresh, relevant context to your chosen LLM. 

This real-time data isn't just essential - it's the key differentiator.

 It’s the difference between fact and hallucination. It’s the difference between winning and losing. 

Wanna get a little dorky? Read more here about optimizing vector databases and enhancing RAG-driven generative AI.

2 – Data streaming: Your competitive edge 💪

Forget the tech giants. 

Data streaming can also be the secret weapon in the mid-market battlefield.

Will's revelation: Real-time data separates leaders from laggards. It's not about data volume; it's about velocity.

Think customer data updates are good enough weekly? 

Wake up. 

Your competitors are reacting in milliseconds.

Every department - sales, support, logistics - synced instantly.

That's not just efficiency; it's customer retention and revenue growth.

Employees drowning in data silos? Streaming breaks the dams. 

Watch productivity soar when teams access real-time, cross-departmental insights.

Will's kicker: GenAI's first big win in mid-sized firms? Internal ops. Imagine every employee with a real-time, AI-powered assistant. That's not sci-fi; it's your new reality.

Try this:

Identify your data bottlenecks. 

Customer feedback? 

Inventory levels? 

Supply chain hiccups? 

Implement streaming there first. Measure the impact on decision speed and accuracy. 

Then, scale across departments. 

And if your company is legit brand new to GenAI and wants to see what it’s capable of, we give you a pretty deep dive into the concept of a simple and free grounded RAG model here. 

3 – Data streaming: From nice-to-have to must-have ✅

Will's warning: In today's market, outdated data isn't just inefficient - it's a liability.

Every financial transaction, every customer interaction relies on split-second data accuracy. 

You're either real-time or irrelevant.

But with power comes responsibility. 

Mismanage your data streams, and you're one breach away from becoming a cautionary tale.

Data governance isn't IT jargon; it's your shield against PR disasters and legal nightmares.

AI hallucinations aren't just embarrassing; they're profit-killers. Without clear data lineage, you're flying blind.

For growing enterprises, real-time data isn't optional. It's the difference between scaling up or getting squashed. 

Try this:

Start with a data audit. 

Map your data flows. 

Identify real-time needs and security gaps. Invest in robust data governance tools. 

They're not expenses; they're insurance policies. Implement AI with caution - always with human oversight. 

Remember, in the streaming era, you're betting your business on every byte. Make each one bulletproof.

Here’s a great guide on how to collect clean data to team up with different GenAI applications. 

⌚

Numbers to watch

105 minutes

According to Google, Gemini customers save an average of 105 minutes per user, per week.

Now This …

Let us know your thoughts!

Vote to see live results

If you don't listen to our podcast, why not?

Login or Subscribe to participate in polls.

Reply

or to participate.