AI Validations

Our artificial intelligence examines the entire webpage’s HTML content, not just visible elements. For visual components, however, our AI only processes what appears in the current viewport through screenshot analysis.

Use AI validations to verify complex conditions using everyday language:

CategoryExample
Text verificationVerify that a confirmation message is displayed on the page
Element verificationCheck that the page shows exactly 3 search results
Logical checksThe blog post’s publication date is more than 30 days old
Page status verificationNo error messages are visible on the screen

Your validations can also include visual attributes. Examples include:

CategoryExample
ColorVerify the checkout button is displayed in blue
LayoutThe ‘XL’ size option is the largest button on screen
ImageryA LinkedIn icon appears on the page

Variables can also be utilized in validations by wraping text with $ $. For example: ‘true if ashfordashford is directly below “Where” in the search bar at the top of the page AND in the listings’

Prompting Best Practices

As you become familiar with our platform, you’ll develop a better understanding of how our AI interprets your validations. We recommend approaching our AI as you would a new QA team member. These guidelines will help you effectively communicate what defines correctness in your application:

  1. Create focused, single-topic validations.

    ❌ The user is logged in and the user's profile picture is in the top right corner and the table is populated.  
    ✅ The user is logged in.
    
  2. Provide clear context and guidance. To avoid confusion, indicate which section of the page the AI should examine or what type of element you’re targeting.

    ❌ Google is visible.  
    ✅ There is a Google logo in the middle of the page.
    
  3. Avoid technical jargon and overly detailed descriptions. Our AI may have difficulty with specialized terms.

    ❌ The page contains a code-mirror div with the text 'https://google.com'.  
    ✅ The page contains a text input that has a URL in it.
    

Unsupported Validations

The following validation types are currently not supported:

CategoryExample
Validations with commandsExpand the dropdown and then check that there are five options available.
Validations over timeAfter 5 seconds, a popup appears.
Subjective validationsThe page looks great!
Complex mathThe average slope of the graph is 31.4.
Complex conditionalsIf the user is logged in, check that their profile photo is visible. Otherwise, check that there is a Google icon on the page.