awesome/tests/test-benchmark.lua

83 lines
2.4 KiB
Lua
Raw Normal View History

Add a benchmark to the test suite This (ab)uses the integration tests to run a benchmark. This currently only measures wibox drawing performance. To avoid wasting CPU-cycles, this does only a quick run under travis while on "normal" runs the function under test is executed in a loop to improve the precision of the measurement. This benchmarks hopefully allow to optimize things in a clear fashion instead of things like "it feels faster to me". Results when run against the previous commit: == Running test-benchmark.lua == create wibox: 0.0788958 sec/iter ( 13 iters, 1.103 sec for benchmark) update textclock: 0.019493 sec/iter ( 56 iters, 2.507 sec for benchmark) relayout textclock: 0.0160725 sec/iter ( 63 iters, 1.029 sec for benchmark) redraw textclock: 0.0015601 sec/iter (647 iters, 1.875 sec for benchmark) W: awesome: a_glib_poll:291: Last main loop iteration took 6.593912 seconds! Increasing limit for this warning to that value. Results right before the new widget layouts were merged (commit 52154d0f15b99b): == Running test-benchmark.lua == create wibox: 0.0782874 sec/iter ( 13 iters, 1.095 sec for benchmark) update textclock: 0.00736755 sec/iter (136 iters, 1.346 sec for benchmark) W: awesome: luaA_dofunction:77: error while running function [...] error: /home/psychon/projects/awesome/build/lib/gears/object.lua:30: Trying to emit non-existent signal 'widget::layout_changed' Closes https://github.com/awesomeWM/awesome/pull/451. Signed-off-by: Uli Schlachter <psychon@znc.in>
2015-09-15 14:09:18 +02:00
-- Some benchmarks that aren't really tests, but are included here anyway so
-- that we notice if they break.
local runner = require("_runner")
Add a benchmark to the test suite This (ab)uses the integration tests to run a benchmark. This currently only measures wibox drawing performance. To avoid wasting CPU-cycles, this does only a quick run under travis while on "normal" runs the function under test is executed in a loop to improve the precision of the measurement. This benchmarks hopefully allow to optimize things in a clear fashion instead of things like "it feels faster to me". Results when run against the previous commit: == Running test-benchmark.lua == create wibox: 0.0788958 sec/iter ( 13 iters, 1.103 sec for benchmark) update textclock: 0.019493 sec/iter ( 56 iters, 2.507 sec for benchmark) relayout textclock: 0.0160725 sec/iter ( 63 iters, 1.029 sec for benchmark) redraw textclock: 0.0015601 sec/iter (647 iters, 1.875 sec for benchmark) W: awesome: a_glib_poll:291: Last main loop iteration took 6.593912 seconds! Increasing limit for this warning to that value. Results right before the new widget layouts were merged (commit 52154d0f15b99b): == Running test-benchmark.lua == create wibox: 0.0782874 sec/iter ( 13 iters, 1.095 sec for benchmark) update textclock: 0.00736755 sec/iter (136 iters, 1.346 sec for benchmark) W: awesome: luaA_dofunction:77: error while running function [...] error: /home/psychon/projects/awesome/build/lib/gears/object.lua:30: Trying to emit non-existent signal 'widget::layout_changed' Closes https://github.com/awesomeWM/awesome/pull/451. Signed-off-by: Uli Schlachter <psychon@znc.in>
2015-09-15 14:09:18 +02:00
local awful = require("awful")
local GLib = require("lgi").GLib
local create_wibox = require("_wibox_helper").create_wibox
Add a benchmark to the test suite This (ab)uses the integration tests to run a benchmark. This currently only measures wibox drawing performance. To avoid wasting CPU-cycles, this does only a quick run under travis while on "normal" runs the function under test is executed in a loop to improve the precision of the measurement. This benchmarks hopefully allow to optimize things in a clear fashion instead of things like "it feels faster to me". Results when run against the previous commit: == Running test-benchmark.lua == create wibox: 0.0788958 sec/iter ( 13 iters, 1.103 sec for benchmark) update textclock: 0.019493 sec/iter ( 56 iters, 2.507 sec for benchmark) relayout textclock: 0.0160725 sec/iter ( 63 iters, 1.029 sec for benchmark) redraw textclock: 0.0015601 sec/iter (647 iters, 1.875 sec for benchmark) W: awesome: a_glib_poll:291: Last main loop iteration took 6.593912 seconds! Increasing limit for this warning to that value. Results right before the new widget layouts were merged (commit 52154d0f15b99b): == Running test-benchmark.lua == create wibox: 0.0782874 sec/iter ( 13 iters, 1.095 sec for benchmark) update textclock: 0.00736755 sec/iter (136 iters, 1.346 sec for benchmark) W: awesome: luaA_dofunction:77: error while running function [...] error: /home/psychon/projects/awesome/build/lib/gears/object.lua:30: Trying to emit non-existent signal 'widget::layout_changed' Closes https://github.com/awesomeWM/awesome/pull/451. Signed-off-by: Uli Schlachter <psychon@znc.in>
2015-09-15 14:09:18 +02:00
local BENCHMARK_EXACT = os.getenv("BENCHMARK_EXACT")
if not BENCHMARK_EXACT then
print("Doing quick and inexact measurements. Set BENCHMARK_EXACT=1 as an "..
"environment variable when you actually want to look at the results.")
end
Add a benchmark to the test suite This (ab)uses the integration tests to run a benchmark. This currently only measures wibox drawing performance. To avoid wasting CPU-cycles, this does only a quick run under travis while on "normal" runs the function under test is executed in a loop to improve the precision of the measurement. This benchmarks hopefully allow to optimize things in a clear fashion instead of things like "it feels faster to me". Results when run against the previous commit: == Running test-benchmark.lua == create wibox: 0.0788958 sec/iter ( 13 iters, 1.103 sec for benchmark) update textclock: 0.019493 sec/iter ( 56 iters, 2.507 sec for benchmark) relayout textclock: 0.0160725 sec/iter ( 63 iters, 1.029 sec for benchmark) redraw textclock: 0.0015601 sec/iter (647 iters, 1.875 sec for benchmark) W: awesome: a_glib_poll:291: Last main loop iteration took 6.593912 seconds! Increasing limit for this warning to that value. Results right before the new widget layouts were merged (commit 52154d0f15b99b): == Running test-benchmark.lua == create wibox: 0.0782874 sec/iter ( 13 iters, 1.095 sec for benchmark) update textclock: 0.00736755 sec/iter (136 iters, 1.346 sec for benchmark) W: awesome: luaA_dofunction:77: error while running function [...] error: /home/psychon/projects/awesome/build/lib/gears/object.lua:30: Trying to emit non-existent signal 'widget::layout_changed' Closes https://github.com/awesomeWM/awesome/pull/451. Signed-off-by: Uli Schlachter <psychon@znc.in>
2015-09-15 14:09:18 +02:00
local measure, benchmark
do
local timer_measure = GLib.Timer()
measure = function(f, iter)
timer_measure:start()
for _ = 1, iter do
Add a benchmark to the test suite This (ab)uses the integration tests to run a benchmark. This currently only measures wibox drawing performance. To avoid wasting CPU-cycles, this does only a quick run under travis while on "normal" runs the function under test is executed in a loop to improve the precision of the measurement. This benchmarks hopefully allow to optimize things in a clear fashion instead of things like "it feels faster to me". Results when run against the previous commit: == Running test-benchmark.lua == create wibox: 0.0788958 sec/iter ( 13 iters, 1.103 sec for benchmark) update textclock: 0.019493 sec/iter ( 56 iters, 2.507 sec for benchmark) relayout textclock: 0.0160725 sec/iter ( 63 iters, 1.029 sec for benchmark) redraw textclock: 0.0015601 sec/iter (647 iters, 1.875 sec for benchmark) W: awesome: a_glib_poll:291: Last main loop iteration took 6.593912 seconds! Increasing limit for this warning to that value. Results right before the new widget layouts were merged (commit 52154d0f15b99b): == Running test-benchmark.lua == create wibox: 0.0782874 sec/iter ( 13 iters, 1.095 sec for benchmark) update textclock: 0.00736755 sec/iter (136 iters, 1.346 sec for benchmark) W: awesome: luaA_dofunction:77: error while running function [...] error: /home/psychon/projects/awesome/build/lib/gears/object.lua:30: Trying to emit non-existent signal 'widget::layout_changed' Closes https://github.com/awesomeWM/awesome/pull/451. Signed-off-by: Uli Schlachter <psychon@znc.in>
2015-09-15 14:09:18 +02:00
f()
end
local elapsed = timer_measure:elapsed()
return elapsed / iter, elapsed
end
local timer_benchmark = GLib.Timer()
benchmark = function(f, msg)
timer_benchmark:start()
local iters = 1
local time_per_iter, time_total = measure(f, iters)
-- To improve precision, we want to loop for this long
local target_time = 1
while time_total < target_time and BENCHMARK_EXACT do
Add a benchmark to the test suite This (ab)uses the integration tests to run a benchmark. This currently only measures wibox drawing performance. To avoid wasting CPU-cycles, this does only a quick run under travis while on "normal" runs the function under test is executed in a loop to improve the precision of the measurement. This benchmarks hopefully allow to optimize things in a clear fashion instead of things like "it feels faster to me". Results when run against the previous commit: == Running test-benchmark.lua == create wibox: 0.0788958 sec/iter ( 13 iters, 1.103 sec for benchmark) update textclock: 0.019493 sec/iter ( 56 iters, 2.507 sec for benchmark) relayout textclock: 0.0160725 sec/iter ( 63 iters, 1.029 sec for benchmark) redraw textclock: 0.0015601 sec/iter (647 iters, 1.875 sec for benchmark) W: awesome: a_glib_poll:291: Last main loop iteration took 6.593912 seconds! Increasing limit for this warning to that value. Results right before the new widget layouts were merged (commit 52154d0f15b99b): == Running test-benchmark.lua == create wibox: 0.0782874 sec/iter ( 13 iters, 1.095 sec for benchmark) update textclock: 0.00736755 sec/iter (136 iters, 1.346 sec for benchmark) W: awesome: luaA_dofunction:77: error while running function [...] error: /home/psychon/projects/awesome/build/lib/gears/object.lua:30: Trying to emit non-existent signal 'widget::layout_changed' Closes https://github.com/awesomeWM/awesome/pull/451. Signed-off-by: Uli Schlachter <psychon@znc.in>
2015-09-15 14:09:18 +02:00
iters = math.ceil(target_time / time_per_iter)
time_per_iter, time_total = measure(f, iters)
end
print(string.format("%20s: %-10.6g sec/iter (%3d iters, %.4g sec for benchmark)",
msg, time_per_iter, iters, timer_benchmark:elapsed()))
Add a benchmark to the test suite This (ab)uses the integration tests to run a benchmark. This currently only measures wibox drawing performance. To avoid wasting CPU-cycles, this does only a quick run under travis while on "normal" runs the function under test is executed in a loop to improve the precision of the measurement. This benchmarks hopefully allow to optimize things in a clear fashion instead of things like "it feels faster to me". Results when run against the previous commit: == Running test-benchmark.lua == create wibox: 0.0788958 sec/iter ( 13 iters, 1.103 sec for benchmark) update textclock: 0.019493 sec/iter ( 56 iters, 2.507 sec for benchmark) relayout textclock: 0.0160725 sec/iter ( 63 iters, 1.029 sec for benchmark) redraw textclock: 0.0015601 sec/iter (647 iters, 1.875 sec for benchmark) W: awesome: a_glib_poll:291: Last main loop iteration took 6.593912 seconds! Increasing limit for this warning to that value. Results right before the new widget layouts were merged (commit 52154d0f15b99b): == Running test-benchmark.lua == create wibox: 0.0782874 sec/iter ( 13 iters, 1.095 sec for benchmark) update textclock: 0.00736755 sec/iter (136 iters, 1.346 sec for benchmark) W: awesome: luaA_dofunction:77: error while running function [...] error: /home/psychon/projects/awesome/build/lib/gears/object.lua:30: Trying to emit non-existent signal 'widget::layout_changed' Closes https://github.com/awesomeWM/awesome/pull/451. Signed-off-by: Uli Schlachter <psychon@znc.in>
2015-09-15 14:09:18 +02:00
end
end
local function do_pending_repaint()
awesome.emit_signal("refresh")
end
local function create_and_draw_wibox()
create_wibox()
do_pending_repaint()
end
local _, textclock = create_wibox()
Add a benchmark to the test suite This (ab)uses the integration tests to run a benchmark. This currently only measures wibox drawing performance. To avoid wasting CPU-cycles, this does only a quick run under travis while on "normal" runs the function under test is executed in a loop to improve the precision of the measurement. This benchmarks hopefully allow to optimize things in a clear fashion instead of things like "it feels faster to me". Results when run against the previous commit: == Running test-benchmark.lua == create wibox: 0.0788958 sec/iter ( 13 iters, 1.103 sec for benchmark) update textclock: 0.019493 sec/iter ( 56 iters, 2.507 sec for benchmark) relayout textclock: 0.0160725 sec/iter ( 63 iters, 1.029 sec for benchmark) redraw textclock: 0.0015601 sec/iter (647 iters, 1.875 sec for benchmark) W: awesome: a_glib_poll:291: Last main loop iteration took 6.593912 seconds! Increasing limit for this warning to that value. Results right before the new widget layouts were merged (commit 52154d0f15b99b): == Running test-benchmark.lua == create wibox: 0.0782874 sec/iter ( 13 iters, 1.095 sec for benchmark) update textclock: 0.00736755 sec/iter (136 iters, 1.346 sec for benchmark) W: awesome: luaA_dofunction:77: error while running function [...] error: /home/psychon/projects/awesome/build/lib/gears/object.lua:30: Trying to emit non-existent signal 'widget::layout_changed' Closes https://github.com/awesomeWM/awesome/pull/451. Signed-off-by: Uli Schlachter <psychon@znc.in>
2015-09-15 14:09:18 +02:00
local function relayout_textclock()
textclock:emit_signal("widget::layout_changed")
do_pending_repaint()
end
local function redraw_textclock()
textclock:emit_signal("widget::redraw_needed")
do_pending_repaint()
end
local function update_textclock()
textclock:emit_signal("widget::updated")
do_pending_repaint()
end
local function e2e_tag_switch()
awful.tag.viewnext()
do_pending_repaint()
end
benchmark(create_and_draw_wibox, "create&draw wibox")
Add a benchmark to the test suite This (ab)uses the integration tests to run a benchmark. This currently only measures wibox drawing performance. To avoid wasting CPU-cycles, this does only a quick run under travis while on "normal" runs the function under test is executed in a loop to improve the precision of the measurement. This benchmarks hopefully allow to optimize things in a clear fashion instead of things like "it feels faster to me". Results when run against the previous commit: == Running test-benchmark.lua == create wibox: 0.0788958 sec/iter ( 13 iters, 1.103 sec for benchmark) update textclock: 0.019493 sec/iter ( 56 iters, 2.507 sec for benchmark) relayout textclock: 0.0160725 sec/iter ( 63 iters, 1.029 sec for benchmark) redraw textclock: 0.0015601 sec/iter (647 iters, 1.875 sec for benchmark) W: awesome: a_glib_poll:291: Last main loop iteration took 6.593912 seconds! Increasing limit for this warning to that value. Results right before the new widget layouts were merged (commit 52154d0f15b99b): == Running test-benchmark.lua == create wibox: 0.0782874 sec/iter ( 13 iters, 1.095 sec for benchmark) update textclock: 0.00736755 sec/iter (136 iters, 1.346 sec for benchmark) W: awesome: luaA_dofunction:77: error while running function [...] error: /home/psychon/projects/awesome/build/lib/gears/object.lua:30: Trying to emit non-existent signal 'widget::layout_changed' Closes https://github.com/awesomeWM/awesome/pull/451. Signed-off-by: Uli Schlachter <psychon@znc.in>
2015-09-15 14:09:18 +02:00
benchmark(update_textclock, "update textclock")
benchmark(relayout_textclock, "relayout textclock")
benchmark(redraw_textclock, "redraw textclock")
benchmark(e2e_tag_switch, "tag switch")
Add a benchmark to the test suite This (ab)uses the integration tests to run a benchmark. This currently only measures wibox drawing performance. To avoid wasting CPU-cycles, this does only a quick run under travis while on "normal" runs the function under test is executed in a loop to improve the precision of the measurement. This benchmarks hopefully allow to optimize things in a clear fashion instead of things like "it feels faster to me". Results when run against the previous commit: == Running test-benchmark.lua == create wibox: 0.0788958 sec/iter ( 13 iters, 1.103 sec for benchmark) update textclock: 0.019493 sec/iter ( 56 iters, 2.507 sec for benchmark) relayout textclock: 0.0160725 sec/iter ( 63 iters, 1.029 sec for benchmark) redraw textclock: 0.0015601 sec/iter (647 iters, 1.875 sec for benchmark) W: awesome: a_glib_poll:291: Last main loop iteration took 6.593912 seconds! Increasing limit for this warning to that value. Results right before the new widget layouts were merged (commit 52154d0f15b99b): == Running test-benchmark.lua == create wibox: 0.0782874 sec/iter ( 13 iters, 1.095 sec for benchmark) update textclock: 0.00736755 sec/iter (136 iters, 1.346 sec for benchmark) W: awesome: luaA_dofunction:77: error while running function [...] error: /home/psychon/projects/awesome/build/lib/gears/object.lua:30: Trying to emit non-existent signal 'widget::layout_changed' Closes https://github.com/awesomeWM/awesome/pull/451. Signed-off-by: Uli Schlachter <psychon@znc.in>
2015-09-15 14:09:18 +02:00
runner.run_steps({ function() return true end })
-- vim: filetype=lua:expandtab:shiftwidth=4:tabstop=8:softtabstop=4:textwidth=80