- Big Data News Weekly
- Posts
- ⚡ Optimizing LinkedIn Sales Navigator’s Search Pipeline with Spark
⚡ Optimizing LinkedIn Sales Navigator’s Search Pipeline with Spark
🦾Plus: X Anthropic Pulls Claude from OpenAI Access

Hey folks! Let’s get into Big Data and AI craziness…
In today's edition: What's Shaping the Future of Data?
🤖 AI Agent Architecture Intelligent Automation
🌍Building a Transformer Model for Language Translation
📝 Extract Structured Information in 3 Lines of Code
🧩 Opensource Digital Twin of Human Society
🎥 xAI rolls out Grok Imagine AI video generator
🤖 Apple's New ‘Answers' Team Eyes ChatGPT-Like Product
💡 AI Tutorial:How to vibe code a mobile app with AI
🤖 AI Tools and Data Tools to checkout

At LinkedIn, the engineering team shifted separated search use cases to a centralized hosted search service, known as search-as-a-service. One of the largest use cases is the search system for LinkedIn Sales Navigator, which leverages AI to identify prospects, enhance engagement, and elevate conversations.
Through Squarespace’s cutting-edge features that combine automation, design presets, creative guidance, and generative AI, Design Intelligence makes it easy to build a beautiful and impactful website. With just a few pieces of information, Blueprint AI generates an entire website customized based off your brand’s goals, name, and personality. It’s AI speed, with Squarespace’s 20+ years of design expertise in website building.

AI agent architecture refers to the underlying framework and design of artificial intelligence systems that enable agents to perform specific tasks autonomously. These agents act in dynamic environments, making decisions based on input data from the surroundings, processing that information, and taking appropriate actions.

The Transformer architecture, introduced in 2017, revolutionized sequence-to-sequence tasks like language translation by eliminating the need for recurrent neural networks. Instead, it relies on self-attention mechanisms to process input sequences. In this post, you’ll learn how to build a Transformer model from scratch. In particular, you will understand:

Google's LangExtract library lets you pull structured data from any unstructured text by showing the model one high-quality example of your desired output format. It handles everything from quick text snippets to full documents, processing them in parallel while maintaining exact source grounding so every extracted piece traces back to its original location. It also generates HTML visualization for exploring results.

Social scientists have a problem: studying human behavior is expensive, time-consuming, and often impossible to control. Now, picture 10,000 AI agents living, working, and arguing about gun control in a virtual city. That's what Tsinghua University's research team created with AgentSociety.
Veterinarians nationwide reported that corporate managers pushed clinics to focus on profit, with vets often paid based on revenue. This encouraged them to see more pets, order more tests, and upsell services, creating a growing burden for uninsured pet owners. Pet insurance could help you offset some of these rising costs, with some providing up to 90% reimbursement. View Money’s top pet insurance picks to see plans starting at only $10/month.
👨💻 Data Tools, Libraries
reactR (GitHub Repo)
The React ecosystem is rich with components that can enhance R web and Shina apps. reactR provides a set of convenience functions for using React in R.
Valkey 8.0 includes stability and performance improvements over the second release candidate and is fully compatible with Redis OSS 7.2.4
Kubesafe (GitHub Repo)
Kubesafe allows developers to safely run commands across multiple Kubernetes contexts.
AI News:

xAI is officially rolling out Grok Imagine — its new AI image and video generator — to all SuperGrok and Premium+ X subscribers on its iOS app, entering a space dominated by Google, OpenAI, Runway, and China’s viral generators. With Grok Imagine, users can turn any simple text prompt or image into a 15-second video, complete with native audio, in seconds.
Here’s how it works:
Take our questionnaire and get matched with a therapist.
Schedule a time to meet and communicate on your terms.
Reach out to your therapist anytime, from anywhere.

Anthropic has terminated OpenAI’s partnership with its Claude models, citing concerns that OpenAI was using them to train competing AI systems. The move underscores rising tension between major AI labs as they increasingly guard their models, data, and commercial advantages.

Apple quietly formed a new team called Answers, Knowledge, and Information earlier this year. The group is exploring a number of in-house AI services with the goal of creating a new ChatGPT-like search experience. Apple recently started advertising job openings for the team, with several listings specifically mentioning experience with search algorithms and engine development.

Reddit has ambitions to become the go-to search engine people use. Its search function has more than 70 million weekly users, and Reddit Answers, its AI-powered Q&A product, is now used by 6 million people. Reddit Answers is currently available in a dozen countries.

OpenAI is reportedly in talks to raise funding at a valuation above $100B, following its recent $8.3B haul, one of the largest private AI funding rounds to date. The company reports user engagement has more than doubled, with 100M people using ChatGPT weekly and more turning to the GPT-4o-powered basic tier.
Former Zillow exec targets $1.3T
The top companies target big markets. Like Nvidia growing ~200% in 2024 on AI’s $214B tailwind. That’s why the same VCs behind Uber and Venmo also backed Pacaso. Created by a former Zillow exec, Pacaso’s co-ownership tech transforms a $1.3 trillion market. With $110M+ in gross profit to date, Pacaso just reserved the Nasdaq ticker PCSO.
Paid advertisement for Pacaso’s Regulation A offering. Read the offering circular at invest.pacaso.com. Reserving a ticker symbol is not a guarantee that the company will go public. Listing on the NASDAQ is subject to approvals.
AI Tutorial
How to vibe code a mobile app with AI

Go to Rork and log in with your account.
Now, describe the mobile app you want to build in the prompt box.
Sample Prompt: “Design an Instagram-style feed. Posts should have a large image, like/comment buttons, a caption with hashtags, and user engagement stats. Include double-tap to like animation and a carousel indicator for multiple images”.
You can also add a sample image for reference.
Wait for a few seconds for Rork to build the app.
Once done, prompt it to make changes to your app.
Download the code or publish your app when you’re ready.
🔥Top AI tools to increase productivity:
Law Blocks is a legal tech ecosystem, offering secure, accessible and affordable legal solutions with the help of AI
SheetMagic: Elevate Google Sheets with AI-driven content and web scraping.
StartKit.AI is a boilerplate designed to speed up the development of AI projects.
CollaborativeAI - Build custom self-hosted AI assistants using the latest models like GPT-4, GPT-3.5, Claude and Gemini.
Clarity AI is a state-of-the-art AI Image Upscaler & Enhancer that supports upscaling from 64px to 37 megapixels
Eazl.ai represents a paradigm shift in the way professionals approach their work.
airapgenerators.com - Create unique AI Raps now, free to use.
View our database of all the best AI tools for your needs: aitoolsup.com
Have cool resources to share? Submit AI tool
A.I. Generated Image of the Day
👀 A Sci-fi world

Recommended reading
SPONSOR US
Get your product in front of Big Data & AI enthusiasts
Our newsletter is read by thousands of tech professionals, investors, engineers, managers, and business owners around the world.
Interested in Sponsoring the Big Data News Weekly Newsletter?Get in touch today
What did you think of today's email?Your feedback helps me create better emails for you! |