STSTEER

autoSTEER

The tool for writing new elements, run on your own machine

Coming soon

autoSTEER is the application we used to build STEER-ME, and this site is autoSTEER running in its read-only public mode. We plan to release it so that you can run it on your own machine and write new elements for either benchmark.

How an element is built

  1. Example seeds. A few example questions per type, with labeled fields for the numbers.
  2. Seed candidates. A language model rewrites the seeds for other domains and perspectives; you accept or reject each one.
  3. Templates. The accepted candidates become templates, filled by a short function that draws the values and computes the answer and the wrong options.
  4. Review. Read filled questions and mark the element ready.