Magic Test
Magic Test allows you to write Rails system tests interactively through a combination of trial-and-error in a debugger session and also just simple clicking around in the application being tested, all without the slowness of constantly restarting the testing environment. You can see some videos of it in action!
Magic Test is still in early development, and that includes the documentation. Any questions you have that aren't already address in the documentation should be opened as issues so they can be appropriately addressed in the documentation.
Magic Test was created by Andrew Culver and Adam Pallozzi.
Sponsored By
Would you like to support Magic Test development and have your logo featured here? Reach out!
Installation
Add this line to your application’s Gemfile:
gem 'magic_test', group: :testThen run the following in your shell:
bundle install
Next, run the install generator:
rails g magic_test:install
With this we will:
- Create a sample system test at
test/system/basics_test.rbthat invokes Magic Test via themagic_testmethod. - Update your configuration to run a visible browser test if
MAGIC_TEST=1is set as an environment variable, and a headless browser setting if the environment variable is not present. - Insert a snippet to render a partial before any closing
</head>tags in your*.html.erbviews within theapp/views/layoutsdirectory.
If you have any views containing
<head></head>tags then please place this snippet so Magic Test can work accordingly.
<%= render 'magic_test/support' if Rails.env.test? %>
Generate binstubs by running bundle binstubs magic_test in the root of your Rails application. Now you'll be able to run Magic Test
with the following command:
bin/magic test test/system/basics_test.rb # for MiniTest
bin/magic spec spec/system/basics_spec.rb # for RSpec
The bin executable is implicitly running your Rails test with an environment variable that Magic Test looks for.
The full command looks like this: MAGIC_TEST=1 rails test test/system/basics_test.rb.
You should be done now! To review what we’ve done for you, be sure to do a git diff at this point and make sure our generators didn’t break anything!
Usage
Running the Example Test
- Open
test/system/basics_test.rbin your editor of choice. - Run
bin/magic test test/system/basics_test.rbon your shell.
This results in three windows:
- A debugger where you can interactively write Capybara test code in the same context it would normally run.
- A browser where you can click around the application and have your actions automatically converted into Capybara code.
- A editor where you mostly just watch test code appear magically, but you can also edit it by hand should you need to.
If you have the screen real estate, we recommend organizing the three windows so you can see them all at the same time. This is the intended Magic Test developer experience. The browser will always open to the left at a width of 800 pixels. This is done so you can set up your other windows just once and expect your browser to appear in the same place during every test.
Using Magic Test in New or Existing Tests
Just add a call to
magic_testanywhere you want to start interactively developing test behavior and run the test the same way we've described above.
Writing Tests Manually in the Debugger Console
You’re now free to issue Capybara commands in the debugger and see their results in the Chrome browser. If you type something and you’re happy with the result, type ok and hit enter to have the last line or block of code you wrote added to the test.
When you’re done writing the test interactively, you can press Control + D to finish running the test.
You can re-run MAGIC_TEST=1 rails test test/system/basics_test.rb or bin/magic test test/system/basics_test.rb to have the test execute up until the point where you stopped, and then re-enter the debugging session to continue writing the test. This is a great workflow for testing your work as you go.
When you’re actually done writing the test, be sure to remove the magic_test reference in the test file.
Recording Your Test Actions in the Browser
You can also write your tests by simply using your app in the browser window. This isn’t perfect yet by any means, but you’ll definitely get a sense for where we’re going with this and it’s already a pretty magical experience and a major productivity booster.
You can click on buttons, click on links, fill in forms, and do many other things the way you would as a normal user. You may find there are certain shortcomings here, but our goal is to tackle all of those edge cases over time.
Generating Assertions in the Browser
Method 1:
If you want to add an assertion that some content exists on the page, simply highlight some text and press ControlShift + A. You should see a confirm dialog asking for if you want to move forward with the assertion or cancel.
Method 2:
You can now generate assertions by selecting your text and right-clicking with your mouse or touchpad.
Flushing In Browser Actions and Assertions to the Test File
The interactive actions you make in your app are not automatically written to your test. When you are ready to write your actions out to the test, go to the terminal window and type flush. This will flush all your recent actions out to the test file. It’s still early days for Magic Test, so you may find you need to clean up some of the output. Please don’t hesitate to submit new issues highlighting these scenarios so we can try to improve the results.
Ambiguous Labels and Elements
When generating test code, we check to ensure a given label or element identifier won’t result in multiple or ambiguous matches the next time a test runs. If that situation arises, we’ll try to generate the appropriate within blocks and selectors to ensure the target button or field is disambiguated.
Acknowledgements
We'd like to thank Florian Plank, the author of Capycorder. His earlier attempt at the same concept (implemented via a Chrome extension) was ahead of its time and provided us with great inspiration and lessons learned when solving this problem from another angle.
Contributing
Bug reports and pull requests are welcome on GitHub at https://github.com/bullet-train-co/magic_test. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the Contributor Covenant code of conduct.
License
The Ruby Gem is available as open source under the terms of the MIT License.