- Big Data News Weekly
- Posts
- 🤖 How to Get 3× Faster Inference from Any LLM
🤖 How to Get 3× Faster Inference from Any LLM
🦾Plus: ✂️ American Express is Cutting 5% of its Workforce
In partnership with
Hey folks! Let’s get into Big Data and AI craziness…
In today's edition: Here is roundup of Canva image model, 1Password, OpenAI Academy 👇
🎨Canva builds its own image model for devs
📝How to structure Markdown files for better coding agents
🏭How to build your own pstack for shipping with agents
🤖 A Free School for Getting Better at AI
💡 AI Tutorial:How to Lock a Chat in ChatGPT
🤖AI Tools and Data Tools to checkout
In this article, you will learn how speculative decoding works, why it produces real speed gains at the hardware level, and what modern implementations look like in practice. Topics we will cover include: The core memory-bandwidth bottleneck that makes standard autoregressive token generation slow. How the draft-and-verify loop works and why it preserves the target model’s output distribution exactly.
Discover laptops with built-in intelligence.
Shift your workforce into hyper-productivity mode with Dell Pro laptops powered by Intel® Core™ Ultra with Intel vPro®. Shop on Dell Premier.
With 10,000 entities to be evaluated, a query per entity design can generate about 10,000 database requests. Even when individual queries execute efficiently, repeated database round trips, network communication, and application-level processing can accumulate significant overhead. Once you have that, optimization of queries is only a part of the solution.
The design platform just rolled out Canva Craft, its first image model trained from scratch. Instead of generating straight from your prompt, it plans the layout and text, then renders at up to 2K across 30+ aspect ratios. Canva claims that planning ahead delivers sharper details, legible text, and cleaner edits. You can easily plug Craft into ad builders or e-commerce workflows through Canva's public API, and agent support via Canva MCP is rolling out soon
🚀 Dive into the World of Machine Learning System Design! 🌐🔍
Ready to uncover the secrets behind how industry giants like Netflix, Airbnb, and Doordash leverage machine learning for unparalleled success? 🤖✨
📘 Download 'ML and LLM System Design: 800 Generative AI Case Studies & 45 ML Platforms': Unlock a treasure trove of insights with 800 real-world case studies from 100+ companies, delving into practical ML use cases and lessons learned in designing ML systems.
This guide shows how to split your agent instructions across AGENTS.md for project context, DESIGN.md for UI rules, and SKILL.md for repeatable workflows. The idea is simple: give agents the right context at the right time so they waste fewer tokens, make smaller diffs, and stick more closely to how your codebase actually works.
This tutorial breaks down the workflow inspired by SpaceX AI/Cursor engineer Lauren Tan’s setup for shipping thousands of PRs. You’ll see how to combine playbooks, reusable skills, subagents, role definitions, and verification loops, then use the whole stack on a real feature instead of just another demo.
👨💻 Data Tools, Libraries
Try Snowflake free for 30 days with $400 in credits and run your analytics, pipelines and AI on one platform. Load your data, run SQL at any scale, and build pipelines and ML models without managing infrastructure.
AI News:
Password manager 1Password launched a new platform that lets AI agents log into user accounts without ever seeing their credentials. The service, 1Password for Agents, creates a verification system where agents request access, users approve the attempt, and 1Password fills in credentials on the agent's behalf, keeping passwords hidden from the AI.
State of Product reveals what AI still hasn’t solved
80% of product professionals say AI helps them ship faster, but customers aren’t seeing value any sooner. Atlassian’s State of Product 2027 explores the gains AI is delivering and the challenges that remain, from decision-making that hasn’t kept pace to gut instinct overriding customer evidence.
American Express has a plan for the AI era, and it starts with a smaller headcount. The card giant is cutting 5% of its workforce to "prepare for AI," CEO Stephen Squeri said Friday. It is taking a $336 million restructuring charge in the quarter, announced the same day it reported third-quarter results.
Daytona thinks AI agents deserve a cloud of their own, and investors are paying up. The three-year-old startup raised a $60M Series B at a $1Bn valuation led by FirstMark Growth, with angels like Stripe's Patrick Collison and Shopify's Tobi Lütke joining in. It has now raised $91M in total. The pitch is that agents spin up thousands of short, stateful jobs, which is not what today's cloud was built for.
Etsy would like its recipes and patterns to come from actual humans, thank you, and it is putting that in writing. The marketplace banned AI-generated recipes and patterns and laid out clearer rules around AI use on its platform. Sellers also can't create bot-generated listings without any human involvement, so the machines will have to find another side hustle.
Signing up for a class to learn something new tends to come with a bill and a schedule that isn’t yours. OpenAI’s Academy skips both, with free courses open to anyone who has a ChatGPT account. It’s built around learning paths, so you start from wherever you are. The one for everyday work covers writing a good prompt and checking
GURU starts Nov 12. Have you saved your spot?
Two full days of email marketing tips and trends, powered by Constant Contact. Famous keynotes (Molly Ringwald, Dan Levy, Amy Porterfield!), DJs, world-record breaking, rom-com fun, and networking.
100% Free & Virtual
29,000+ Marketers Joined Last Year
November 12th & 13th
AI Tutorial
How to Lock a Chat in ChatGPT
OpenAI says the feature is designed for situations where users might be discussing something personal or planning a surprise and want to keep those conversations private when handing their device to friends or family to show them something in another chat.
To lock a chat:
Go to ChatGPT, sign in, and start a conversation.
Open the more options menu (•••) for the chat.
Select Lock chat.
Create your account PIN when prompted. (On supported mobile devices, you can also use Face ID, Touch ID, or your device unlock method.)
The chat then moves into Locked chats. Its title and content are removed from regular chat history and regular conversation search.
Unlike the app’s Temporary Chats feature, which provides a separate session that doesn’t appear in chat history, you can return to locked chats at any time.
Find your locked chats under Projects > Locked chats. Enter your account PIN or use supported device authentication, when available. Then select the conversation you want to open.
To unlock a chat, open it, select the more options menu (•••), then select Unlock chat (or Unlock on iOS). Confirm Unlock chat to return the conversation to your regular chat history.
Jobs:
This week's Data & Analytics jobs: I have updated my curated list with fresh openings. Browse and apply in one click: jobs
Machine Learning Engineer – Hybrid – Boston
Lead Machine Learning Engineer – Texas
🔥Top AI tools to increase productivity:
Best Face Swap is an online tool that lets you replace faces in digital media using various AI models.
Framia Pro is an all-in-one AI platform for creating and editing images and videos
xLeadForge is an X outbound workspace for people who need to find and contact the right audience
Ito is an AI-powered quality assurance platform built for modern software teams
Creatii AI helps creators, marketers, and brands generate polished AI videos, images
dOCR is one API for documents and the web
View our database of all the best AI tools for your needs: aitoolsup.com
Have cool resources to share? Submit AI tool
A.I. Generated Image of the Day
👀 The Geometry of an Impossible Truth
Recommended reading:
SPONSOR US:
Get your product in front of Big Data & AI enthusiasts
😮 The Marketing Channel You've Probably Slept On:
Haven't tried newsletter sponsorships yet? You are missing out on a HUGE ROI+ customer acquisition channel. I know because dozens of advertisers keep coming back for more... Run a test campaign with us and see for yourself 👉 Get in touch today.
What did you think of today's email?Your feedback helps me create better emails for you! |