Touched. Fixing CI

[kettanaito]

• Closes Introduce "touched" concept #289
• Fixes Establish reliable CI pipeline #287

Roadmap

• Add touched property to the field record
• Add unit test on recordUtils to ensure default value of the touched property
• Adjust Form.reset integration scenario
• Adjust Form.setErrors() integration scenario
• Migrate integration test suits to run against running Storybook
  • Interaction
  • Behavior
  • Field grouping
  • Components
  • Validation
  • Reactive props
• Build Storybook prior to integration tests
• Establish a simple server serving built Storybook

[kettanaito]

There is an issue that field value assertions includes wrong value (i.e. expected foo, includes oo). It's usually all but the first character in the field. The actual field value in the DOM is also wrong.

I am starting to think it has to do with #268. Still confusing to me why it happens occasionally. Test suits on local in GUI are fine, on local in console are broken.

[kettanaito]

Removing touched assertions from the default tests results into CI passing.

The separate touched assertion test fails, indicating the failing domain, which is good. Focusing on making that test correct.

[kettanaito]

Migrating integration test suits to run against open Storybook server.

Motivation:

• Eliminate intermediate rendering layer when rendering the suits
• Be as close to Storybook as possible
• Have no runtime context (Storybook is already built and running)
• Eliminate context overlapping issues (unmounting/async actions)
• Cypress to act more like E2E testing, rather than integration one

[kettanaito]

I've finished the test migration. What I can see so far, is that building storybook's development version takes very long during the CI. Might consider building production version of storybook, run it, and test against it. That should be generally faster.

[kettanaito]

Even after changing the tests to run against Storybook, the pipeline reliability is still poor.

As previously, I see tests perfectly passing in both GUI and CLI on local, yet failing on CircleCI. The next strategy is to eliminate context change during tests, meaning that a test scenario is loaded once, and the group of test suits are executed sequentially, without reloading/reseting the scenario.

At least, the speed of CI became higher. Going to stay positive about something.

[kettanaito]

Tried increasing default timeout on Cypress from 4000ms to 10000ms (2x), didn't help.