- Big Data News Weekly
- Posts
- 🤖 IBM's new retrieval system hallucinates 65x less than RAG
🤖 IBM's new retrieval system hallucinates 65x less than RAG
🦾Plus: 🧞 Genie 4 brings sound and interactivity to AI worlds
In partnership with
Hey folks! Let’s get into Big Data and AI craziness…
In today's edition: Here is roundup of Genie 4, LFM3 model, M6 Chip, BlueChip laptop 👇
🧠Liquid AI Drops LFM3, Tiny Local Models That Crush Giants
⚙️How to build your own reasoning model from scratch
💻How to review AI-written code at Anthropic scale
💻 Apple Unveiled a 14-Inch MacBook Pro With its M6 Chip
💊 Anthropic starts developing its own drugs
💡 AI Tutorial:How to Have ChatGPT Take Your Meeting Notes
🤖AI Tools and Data Tools to checkout
Retrieval Augmented Generation (RAG) is a key component for generating accurate and hallucination free answers using Large Language Models (LLMs). LLMs are improving at handling long context, but still suffer from "lost in the middle" problem. Thus, precise and accurate retrieval is important. Current retrievers chunk long context into length-based manageable chunks - in the process throwing away rich and informative semantic global structure in the corpus.
Nobody's coming to approve your idea
People assume that real businesses get built by other people with more resources. It's how great ideas get stuck in notes apps and conversations.
But you don't need six months and a developer's salary to validate your concept. You just need a weekend. Describe what you want to exist and Lovable builds it: a real site, a real product, ready to accept real payments from real customers. Not a mockup to show people. An actual thing they can use.
You don't need anyone's sign-off to get started. Take $5 off your first month.
Discount of $5 applies to first month of any paid plan. You need to sign up via this webpage in order to claim the discount. The discount applies to new and returning users without an active paid plan. Terms apply.
An artificial intelligence (AI) agent is given a straightforward objective: fix a suite of failing automated tests and return it to a 100% pass rate. Overnight, the agent reaches the target. Every test is green. The problem is how the agent achieved the target. Rather than repairing every failure, the agent commented out roughly 20 tests it could not fix.
Liquid AI just launched LFM3, a new family of tiny multimodal models built to run locally on phones, laptops, and other edge hardware. It includes 6 models around the 2B-parameter range, covering text, vision, audio, omni, and decision tasks: LFM3-1.7B has a 256K context window and fits in roughly 1 GB of memory at 4-bit precision.
🚀 Dive into the World of Machine Learning System Design! 🌐🔍
Ready to uncover the secrets behind how industry giants like Netflix, Airbnb, and Doordash leverage machine learning for unparalleled success? 🤖✨
📘 Download 'ML and LLM System Design: 800 Generative AI Case Studies & 45 ML Platforms': Unlock a treasure trove of insights with 800 real-world case studies from 100+ companies, delving into practical ML use cases and lessons learned in designing ML systems.
This 8-part course takes you from a pre-trained Qwen3 model to a working reasoning model in Python and PyTorch. You’ll build the evals, add inference-time scaling and self-refinement, train with GRPO and verifiable rewards, and then distill the final model from a stronger teacher.
A principal AI engineer breaks down how the Claude Code team manages over 30,000 daily changes in a codebase that is 90% AI-written. Learn how they combine subagent reviews, automated security checks, risk-tiered approvals, and fast rollbacks so engineers only review high-risk PRs instead of getting bogged down by every single one.
Holiday Growth Is Great. Keeping More of It Is Better.
A record-breaking holiday season can still leave brands wondering: Where did all the profit go?
9 Plays to Defend Your Margin This Holiday Season shares tactical moves from e-commerce leaders across creator payouts, inventory, pricing, marketplaces, fulfillment, and returns.
Use them now because a bigger Q4 only matters if you keep more of it.
👨💻 Data Tools, Libraries
VectorAI DB: Do you need a vector database? Find out in 30 seconds. Before you budget for a vector database, check whether you need one. Answer a few questions about your data, latency, filtering and deployment.
Try Snowflake free for 30 days with $400 in credits and run your analytics, pipelines and AI on one platform. Load your data, run SQL at any scale, and build pipelines and ML models without managing infrastructure.
Pomerado: Turn websites and old internal portals into APIs or MCP tools for your agents, without waiting for an official API
AI News:
Google DeepMind just introduced Genie 4, its next-gen world model that turns prompts into explorable, photorealistic scenes in real time, with features like built-in, natively generated audio and lifelike people that users can actually interact with. Genie 4 is the first Genie model to generate its own sound, like background noise and music, with characters in the worlds also now able to hold live conversations.
Free email without sacrificing your privacy
Gmail tracks you. Proton doesn’t. Get private email that puts your data — and your privacy — first.
Apple just reminded you that your laptop is, technically, a chip behind. The new 14-inch MacBook Pro with Apple's M6 chip starts at $1,999 in space black or silver, promises 24 hours of battery life and adds Wi-Fi 7 and Bluetooth 6. Apple also revealed an M6 iMac from $1,499 a day before its Pro and Tell event. Preorders open October 28, with shipping starting November 6.
Eight years at Meta, and Rohit Patel decided the real moonshot was a word processor. The Meta Superintelligence Labs director left to launch Ndoc, which he pitches as an AI-native rival to Microsoft Office and Google Workspace. It has a team of three, no funding, an enterprise pilot and a waitlisted alpha, with a beta planned in the coming weeks. He follows exits by Joel Kaplan, Andrew Tulloch and Emily Dalton Smith.
Anduril and Qualcomm are betting a laptop can be made in America, component by component. BlueChip is a hardened machine for military, government and law enforcement buyers, with about 90% of its parts from the U.S. or allies, including a Snapdragon X chip made at TSMC's Arizona fab. Palmer Luckey says it will be heavier, with shorter battery life, and cost roughly 20% more than typical high-end PCs. Preorders are slated for 2027
Anthropic shared early results with its drug-development partners and revealed it’s now running its own drug discovery programs, including buying Mithril Medicine, a solo-founder biotech whose Claude-assisted muscular dystrophy candidate could reach human trials as early as late 2028.
AI Tutorial
How to Have ChatGPT Take Your Meeting Notes and Turn Them into Action
ChatGPT’s Meetings plugin can capture meeting audio, create a personalized summary, and suggest follow-up tasks, such as drafting emails or updating project plans.
Download and open the ChatGPT desktop app on your Mac.
Open Plugins in the sidebar, search for Meetings, and install it.
Open Meetings from the sidebar and complete the setup. Allow access to your microphone and system audio when prompted.
Click Take notes to start. You can add your own notes to the meeting page to capture personal thoughts, questions, or extra context.
Once finished, Meetings will process the audio and use the transcript, your notes, and relevant authorized connected-app context to prepare a summary and suggested action items.
Review the notes for accuracy, then edit or start suggested actions. You can also ask ChatGPT questions about what was discussed.
You can keep the meeting page private or share it with others. Shared pages give recipients access to the notes, but not the transcript.
Jobs:
This week's Data & Analytics jobs: I have updated my curated list with fresh openings. Browse and apply in one click: jobs
Machine Learning Engineer – Hybrid – Boston
Lead Machine Learning Engineer – Texas
🔥Top AI tools to increase productivity:
Best Face Swap is an online tool that lets you replace faces in digital media using various AI models.
Framia Pro is an all-in-one AI platform for creating and editing images and videos
xLeadForge is an X outbound workspace for people who need to find and contact the right audience
Ito is an AI-powered quality assurance platform built for modern software teams
Creatii AI helps creators, marketers, and brands generate polished AI videos, images
dOCR is one API for documents and the web
View our database of all the best AI tools for your needs: aitoolsup.com
Have cool resources to share? Submit AI tool
A.I. Generated Image of the Day
👀 Guardians of the Celestial Frontier
Recommended reading:
SPONSOR US:
Get your product in front of Big Data & AI enthusiasts
😮 The Marketing Channel You've Probably Slept On:
Haven't tried newsletter sponsorships yet? You are missing out on a HUGE ROI+ customer acquisition channel. I know because dozens of advertisers keep coming back for more... Run a test campaign with us and see for yourself 👉 Get in touch today.
What did you think of today's email?Your feedback helps me create better emails for you! |