In this blog, we'll showcase how our PonderAi effortlessly navigates an online furniture store via a web browser, just one of its limitless possibilities.
The experimental feature leverages on two technologies:
Computer Vision: At the heart of this capability is computer vision, a field of AI that empowers machines to interpret and understand visual information. Our PonderAi employs computer vision algorithms to "see" and interpret the content displayed in web browsers. This means it can identify buttons, links, text fields, images, and other elements on web pages.
Large Language Models (LLMs): Our PonderAi harnesses the immense power of Large Language Models. LLMs are capable of understanding and generating human-like text based on natural language input. This enables seamless communication between users and the PonderAi.
The Autonomous Web Browsing Process
Here's how our PonderAi's autonomous web browser navigation works:
Visual Analysis: When instructed to perform a web search or browse a specific website, the PonderAi uses computer vision to analyze the visual elements on the webpage. It identifies buttons for search bars, product listings, and more.
Natural Language Interaction: Users can interact with the PonderAi using natural language commands. They can instruct it to search for products, click on links, scroll down, or perform other browser actions.
Decision-Making: PonderAi's self-thought and reasoning capabilities enable it to autonomously analyse information, make informed decisions, and provide personalised assistance, making it a valuable companion across various tasks and situations.
Autonomous Execution: Armed with a combination of visual understanding and language comprehension, the PonderAi autonomously performs the requested actions within the web browser. It can navigate through search results, fill out forms, and even make purchases on e-commerce websites.
The AI Assistant in Action
Our agent-based PonderAi streamlines online furniture shopping:
Natural Language Understanding: Easily instruct the AI using natural language for a human-like interaction.
Web Browsing Skills: Watch as it searches for the perfect sofa, clicks on relevant listings, and narrows down options.
Our PonderAi's autonomous web browser navigation feature is just the beginning. Stay tuned for more exciting developments!