On Tue, Jun 13, 2023 at 4:26 PM Kees Cook keescook@chromium.org wrote:
On Sat, Jun 10, 2023 at 12:51:46AM +0000, Rae Moar wrote:
Add filtering of test attributes. Users can filter tests using a module_param_array called "filter". This functionality will be added to kunit.py in the next patch.
The filters will be imputed in the format: "<attribute_name><operation><attribute_value>"
Example: "speed>slow"
Operations include: >, <, >=, <=, !=, and =. These operations do not need to act the same for every attribute.
How is the "default" filter specified? Is explicitly unfiltered? (i.e. "slow" stuff will run by default?) Or should there be a default filter of "speed<slow" for the memcpy conversion?
But yes, I'm a fan of this whole series! I would much prefer this to having one-off CONFIGs for slow tests. :)
Hello!
Great to hear that you are happy to see this series.
Currently if no filter is specified, tests will run unfiltered (so the slow tests will run by default).
But I think the idea of having a "default" filter is really interesting. I would definitely be open to adding a default filter that only runs tests with speeds faster than slow, which could then be overridden by any filter input.
This also means there could be suite specific default filters but that may be a future implementation since we currently only have one attribute.
Or alternatively we could have a file that includes a list of default filters that could then be inputted and altered based on suite.
Thanks! Rae
-- Kees Cook