- Big Data News Weekly
- Posts
- 👩💻 DeepSeek lets you build agent plugins with a prompt
👩💻 DeepSeek lets you build agent plugins with a prompt
🦾Plus: 📋 OpenAI grades its AI on everyday tasks
In partnership with
Hey folks! Let’s get into Big Data and AI craziness…
In today's edition: Here is roundup of Deepseek harness, OpenAI LifeVal, Git at OpenAI 👇
💻Scaling Git at OpenAI
🏭How to build your own Claude Code software factory
🔬Progress on provable inference for large language models
🚨 Anthropic Refiles IPO as AI Self-Improvement Risks Loom
💡 AI Tutorial:How to Connect Your iCloud Mail and Calendar to ChatGPT
🤖AI Tools and Data Tools to checkout
When you talk to a friend in person, you have many ways to know it is really them: you can see them, hear them, shake their hand. When you talk to an AI model, you have almost none. A user querying a model today cannot check that the responses came from the specific model that a developer claims is responding, as opposed to one secretly substituted in by a routing service for cost reasons, or even by an attacker who has tampered with the token stream.
Analytics on Billions of Rows, Still in Postgres
Postgres handles your app data fine. It's the analytics queries that start dragging once tables reach hundreds of millions of rows. TimescaleDB extends Postgres so those queries stay fast as data grows, without moving anything out. Plexigrid cut query times from 5 minutes to half a second after switching from InfluxDB. Hypertables partition data automatically. Columnar compression shrinks storage up to 95%, so each query reads less. Continuous aggregates pre-compute your rollups. It's still Postgres: same SQL, same drivers, same tools. Start on Tiger Cloud and get $1000 in credits.
Python is a powerful and versatile programming language, but writing clean, efficient, and error-free code can be challenging. Thankfully, there are numerous tools available to help developers enhance their Python coding skills. Below are 20 essential tools that can improve your Python development experience.
OpenAI's monorepo's size and demands increased at a staggering pace over the last year, necessitating a revamp of the AI lab's source control system. Its technical staff built Pando, a new backend for Git repositories optimized for concurrent pushes to many branches and to maximize read throughput. The team implemented the backend without interrupting any engineering work or changing how the team uses Git.
🚀 Dive into the World of Machine Learning System Design! 🌐🔍
Ready to uncover the secrets behind how industry giants like Netflix, Airbnb, and Doordash leverage machine learning for unparalleled success? 🤖✨
📘 Download 'ML and LLM System Design: 800 Generative AI Case Studies & 45 ML Platforms': Unlock a treasure trove of insights with 800 real-world case studies from 100+ companies, delving into practical ML use cases and lessons learned in designing ML systems.
The Chinese AI lab just rolled out Creator Mode for DeepSeek Harness, letting you create plugins simply by describing what you want in a text prompt. While models decide what to do, a harness is what gets the job done. DeepSeek’s open-source Harness takes an “everything is a plugin” approach, so whether you need a tool, skill, or interface tweak, the agent will build it for you. It’s still in preview, though, so expect API changes.
This tutorial shows how to stop babysitting coding agents and build a workflow where a linear ticket kicks off the work, multiple agents build in parallel, and you only step in when a decision actually needs you. You’ll learn how to combine Claude Code, T3 Code, PStack, cloud sandboxes, playbooks, and verification into one repeatable setup.
Learn AI engineering, data analytics, and Python for $0
This week only.
All 700+ DataCamp courses, career tracks, and certifications are free from November 2nd-8th. No credit card required. Check out all DataCamp free courses on the Free Access Week Page.
👨💻 Data Tools, Libraries
VectorAI DB: Do you need a vector database? Find out in 30 seconds. Before you budget for a vector database, check whether you need one. Answer a few questions about your data, latency, filtering and deployment.
Try Snowflake free for 30 days with $400 in credits and run your analytics, pipelines and AI on one platform. Load your data, run SQL at any scale, and build pipelines and ML models without managing infrastructure.
DwarFS is a read-only file system with very high compression ratios for very redundant data.
kvass is a personal key-value store.
AI News:
OpenAI just introduced LifeVal, a new test grading how well AI gets through everyday errands like booking appointments, buying groceries, and filling out government forms, with tasks chosen based on what people say they want help with. The selected task areas come from a poll of 4K people on where they want help, and global time-use surveys on what everyday tasks consume time.
Unlock up to $2 million licensing your company data
Have a business larger than 20 people that lives on Slack and is older than a year? Companies like Micro1 want to pay $100k - $2 million to license your data. They anonymize it and then use it to train the next set of frontier AI models.
Anthropic has revised its IPO filing with a new warning about self-improving AI, alongside major financial disclosures as it prepares to go public.Anthropic warns future models may soon reach its threshold for dramatically accelerated AI research. Q3 revenue jumped 47% to $16.96 billion, but Anthropic swung from a $974 million operating profit in Q2 to a $567 million loss.
OpenAI just sealed four agreements in Abu Dhabi, bringing its AI to state oil giant ADNOC, the emirate’s government, and state investor Mubadala, while a UAE group is reportedly set to be the top investor in the AI giant’s raise of up to $20B. ADNOC’s deal, the largest of the four, aims to cut oil field planning from months to hours by running decades of well data through OpenAI’s models.
Turns out The New York Times has found a new target, and it's the privacy-first browser Brave. The Times sued Brave on Monday, alleging it scraped copyrighted content and sold it on to AI customers like Anthropic, Perplexity, Mistral, xAI, and Cohere. The suit calls Brave an AI "fence" for stolen goods, citing an index of 30 billion pages. Brave hasn't responded... yet.
Europe's supermarkets are learning that a smart fridge can be a very dumb idea. A second wave of suspected cyberattacks has warmed refrigerators at dozens of stores in Belgium, Ireland, Luxembourg, and Sweden, with Ahold Delhaize and Colruyt confirming hacks. Researchers point to internet-connected Danfoss units that no longer received security updates. Shoppers should expect some very sad freezer aisles... and a lot of tossed groceries.
Replace your traditional insurance broker.
WithCoverage replaces your company’s traditional insurance broker with AI-enabled insurance experts and attorneys. We bring 40+ competing carriers, flat fees instead of commissions, and one platform for policies, claims, and COIs.
Join 1,000+ businesses like GoPuff, Polymarket, and Opendoor.
Start with a free, confidential policy review to identify savings and better protect your business.
AI Tutorial
How to Connect Your iCloud Mail and Calendar to ChatGPT
ChatGPT can now read and send your iCloud emails, check your schedule and create calendar events. It's handy if you run your business from an iPhone or a Mac. Here's how to set it up.
Go to Account and sign in.
In Sign-In and Security, select App-Specific Passwords.
Select Generate an app-specific password, follow the prompts and copy the password.
In ChatGPT, open Settings → Plugins and find iCloud Mail.
Follow the connection prompts. Use your @icloud.com, @me.com, or @mac.com address, and paste the app-specific password when prompted.
Repeat for iCloud Calendar, using your main Apple Account email. It may be different from your iCloud Mail address.
Ask ChatGPT something like "Summarise my unread emails and suggest replies" or "What's on my calendar this week?"
Available on every ChatGPT plan, including Free, on web, desktop and iOS
Jobs:
This week's Data & Analytics jobs: I have updated my curated list with fresh openings. Browse and apply in one click: jobs
Machine Learning Engineer – Hybrid – Boston
Lead Machine Learning Engineer – Texas
🔥Top AI tools to increase productivity:
Marblism generates a fully-functional web application from a single prompt:
Clipwing A tool for cutting long videos into dozens of short clips
aiPDF is an innovative, multi-modal tool designed to work with a wide array of inputs, including ebooks, web articles, YouTube videos, podcasts.
xLeadForge is an X outbound workspace for people who need to find and contact the right audience
Ito is an AI-powered quality assurance platform built for modern software teams
Creatii AI helps creators, marketers, and brands generate polished AI videos, images
dOCR is one API for documents and the web
View our database of all the best AI tools for your needs: aitoolsup.com
Have cool resources to share? Submit AI tool
A.I. Generated Image of the Day
👀 Brutalist Fast Food Restaurants
Recommended reading:
SPONSOR US:
Get your product in front of Big Data & AI enthusiasts
😮 The Marketing Channel You've Probably Slept On:
Haven't tried newsletter sponsorships yet? You are missing out on a HUGE ROI+ customer acquisition channel. I know because dozens of advertisers keep coming back for more... Run a test campaign with us and see for yourself 👉 Get in touch today.
What did you think of today's email?Your feedback helps me create better emails for you! |