User post

A Siri shortcut sends screenshots to a dot that looks up what is in them

Priyaa built appshots for iOS with dots and Shortcuts. Saying “Hey Siri, run dots” takes a screenshot and emails it to an inbox that the dot checks, and the dot then finds the shoes, class, book, or video the screenshot points to.

What it is

Priyaa (@pritopian) posted about appshots for iOS, built with dots and Shortcuts. The post says that saying “Hey Siri, run dots” makes Siri take a screenshot and send it to the dot, which handles the rest in the background. Examples in the post: it finds the shoes a woman in a reel was wearing, signs up for a free gym class from an ad, orders a book mentioned in a podcast, and saves a video referenced in an X post to watch later. The post says the dot reads the screenshot, listens to voice notes, and uses its own browser to look up YouTube videos and X posts. For walled apps like Instagram, the poster gave the dot its own account. Results are saved to a ChatGPT Site and a Google Doc. Because an iOS shortcut cannot talk to dots directly, the shortcut emails the screenshot to an inbox that the dot checks regularly. The poster says the accuracy has been great. This page restates that user post. It is not an OpenAI statement and not an independently verified case study.

Evidence

User post on X by Priyaa (@pritopian). Not an OpenAI statement and not an independent case study.

Caveats

  • The poster’s X post only. This page does not add details the post does not state.
  • Not a verified independent case study. Not an OpenAI statement.
  • The post says an iOS shortcut cannot talk to dots directly, so the shortcut emails the screenshot to an inbox that the dot checks regularly.
  • The post says the poster gave the dot its own Instagram account. That platform’s account rules may apply.
  • The post says the dot orders a book and signs up for a free gym class. These steps use the poster’s own accounts. The post does not say how purchases are approved.
  • The post includes a 33-second video. This page does not describe the video.

This page restates a user’s X post. It is not an OpenAI statement and not an independent case study.