Skip to content

Try varying interactive draws in Phase.explain #4403

@Liam-DeVoe

Description

@Liam-DeVoe

Phase.explain currently only tries to vary the known-ahead-of-time args and kwargs to the test function, via arg_slices. This does not include interactive draws from st.data() - so, we should fix that!

  • Run explain-phase experiments on interactive draws as well, possibly by simply adding their choice sequence ranges to arg_slices.
  • Add comment annotations to the printed Draw 1: ... output from the experiment results, like we do for function arguments. slice_comments.
    • Probably by adding to slice_comments (as for function arguments), and handling interactive-draw slices specially when printing dynamic draws?

(via #4399 (comment))

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementit's not broken, but we want it to be better

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions