heyclicky is an AI-powered assistant designed to operate directly on the macOS environment. Developed by Farza, the application acts as a companion that provides real-time guidance and assistance by observing the user's screen and listening to voice inputs. By sitting adjacent to the cursor, it maintains a constant presence, allowing users to interact naturally with their computer and receive immediate help with ongoing tasks.

The application functions as an intelligent layer that understands the context of a user's workflow. Users can ask questions out loud to receive step-by-step guidance, or initiate autonomous agents to perform specific background tasks. By utilizing screen-awareness and voice recognition, heyclicky minimizes the friction associated with switching between applications or searching for external documentation when encountering complex tasks or software interfaces.

Some of the key features are:

• Persistent Presence: Sits next to the cursor for immediate interaction and assistance with active tasks.
• Screen Awareness: Observes the user's screen in real-time to provide context-aware responses and guidance.
• Voice Interaction: Processes natural language voice commands via push-to-talk to facilitate hands-free assistance.
• AI Agent Mode: Allows users to spin up dedicated agents for building, researching, or managing tasks in the background.
• Third-Party Model Integration: Leverages advanced AI models from providers including Anthropic, OpenAI, AssemblyAI, and ElevenLabs to deliver high-quality responses.

To use the tool, the user activates the interface and interacts via voice commands. When a user asks a question, the local application captures the necessary screen information and audio input, processing them through a secure backend proxy to communicate with integrated AI providers. This architecture ensures that complex requests, such as transforming designs into functional code or researching information, are handled efficiently while the user continues their work. The tool also incorporates robust privacy practices, including local data capture and encryption, to maintain security standards.

Some common use cases include:

• Technical Tutorials: Asking for guidance on using specific software features or tools, such as explaining an Adobe After Effects panel.
• Content Creation Support: Assisting with creative workflows, such as helping to design a logo within a design application like Figma.
• Research and Synthesis: Utilizing an AI agent to summarize complex documents like PDFs and managing related tasks such as emailing the summary to a team.
• Market Analysis: Using the agent to find and compare products based on visible screen elements, such as finding specific cameras within a defined budget.
• Code Generation: Instructing the agent to convert design mockups from platforms like Figma into working web pages.