Data Quality

Plugins

The data quality check is a critical step that occurs when live orders are passed to the production environment, just before Calibration begins. The purpose of it is to identify any integration issues and to avoid negative impacts on our decision quality.

The data quality check is a critical step that occurs before Calibration (see Calibration section) begins. Data quality checks are performed on live orders in a production environment. During this phase of onboarding, Signifyd is set to passive mode and will have no impact on existing workflows within Shopify.

For plugin integrations, that majority of the data analysis will be conducted by the assigned Signifyd Implementation Manager, who will report back any findings. In the event that data is not meeting minimum requirements, additional instructions will be sent to improve data quality in the given scenario.

📘

For anyone interesting in reviewing the data quality themselves, Developer Tools access (images below) may be requested. This is a free add on that will allow for you to see the quality of your data when it is passed with your orders directly in the console.


Below is an initial checklist of data points checked after confirming basic order information is passing correctly.

  • Device ID (device profiling)
  • Is a unique Session ID generated?
  • Are Device IDs captured?
  • Confirmation Email
  • Confirmation Phone
  • BIN
    • _Required for a pre-auth integration
    • Critical for post-auth integrations
  • Last 4
    • _Required for a pre-auth integration
    • Critical for post-auth integrations
  • AVS
  • CVV
  • Billing Address & Delivery Address
    • Are addresses formatted correctly?
  • Digital items
    • Are products labeled as digital?
    • What do we see for the delivery address field when an order contains only digital items?
    • What does the delivery method show for digital-only orders, and mixed orders with both digital and physical?
  • Product names
    • Does the full product name appear or partial?
    • Do categories and subcategories pass?

While this list includes some of the most important data points expected to pass to Signifyd, it is not an exhaustive list of everything checked by Signifyd. If you are aware of any lacking data elements, please inform your Implementation Manager or support.

Also, keep in mind that different payment tools will act differently. Some payment sources do not provide all data points that we have requested. In these situations, the known data or expected missing data points have already been taken into consideration in the Signifyd model and would not be required.

❗️

It is important to keep Signifyd aware of changes in the future. If there are plans to update any major component of your order flow, please notify us via email in advance so that we may assist in maintaining consistent data quality.