Skip to content

Latest commit

 

History

History

benchmark

Benchmarks

This is directory that contains scripts and reports from system benchmarks

Running specific benchmarks

  • To run Blind Index and OPE benchmark use: pytest . --benchmark-histogram
  • To run MQTT benchmark use query.sh with updated BROKER, USERNAME, PASSWORD, TOPIC arguments and id of your network
  • To run OpenDoor scanner:
  • To see hash function distribution plot run tuple_generation.py and optionally switch between hash functions by switching the x assignments in the file (# x = [...])
  • To run Locust.io benchmarks you will need to first start server application, then run locust --host=https://localhost, you can then open browser UI at http://localhost:8089/
    • You can also choose which server endpoints to test by changing task_set = UserBehavior to one of the classes in the comment

Reports

  • All reports are inside ./reports folder grouped by specific benchmark
  • To correctly display interactive plots for Blind Index and OPE please use web browser, e.g. Chrome
  • For Hawkeye scanner there are two reports - one for server application and one for client (user and device CLI)
    These files contain all found vulnerabilities with their level, description and file + line location
  • For MQTT broker benchmark, there are also 2 reports - one with authentication caching and one without, there is also a query.sh file with command that was used to run those benchmarks
  • For OpenDoor scan there is one file showing all files the scanner looked for and whether they were found or not