From 611bae15712964c865ba9a6e30fe32f5b6a10540 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 18:35:19 +0200 Subject: [PATCH 01/17] Default commit message, part of an automated flow. --- later.md | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-) diff --git a/later.md b/later.md index 4f9ad228a..ded93f148 100644 --- a/later.md +++ b/later.md @@ -3,8 +3,16 @@ - a [[list]]. - [[irregular]] - Thoughts that come up while I was doing [[pomodoro]]. - - Write about [[excursion]]. - - [[onkyo volume]] + - [[slay moloch]] + - [[sorting pushes]] + - [[pull arbitrary urls]] + - pull wikipedia works + - [[write]] [[topology]] + - [[write]] [[on building bridges]] + - [[topology]] + - Write about [[excursion]]. + - [[onkyo volume]] + - ? meh - Write about [[music mouse]]. - Write a post about my [[virtual desktop setup]]. - [[pull]] means [[uprank]] From 635df45bddd68f1d1e552b95b98387d44364c084 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 18:37:13 +0200 Subject: [PATCH 02/17] Default commit message, part of an automated flow. --- later.md | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/later.md b/later.md index ded93f148..7c05abc77 100644 --- a/later.md +++ b/later.md @@ -7,8 +7,13 @@ - [[sorting pushes]] - [[pull arbitrary urls]] - pull wikipedia works - - [[write]] [[topology]] + - fix duplicate [[go links]] behaviour - [[write]] [[on building bridges]] + - [[write]] [[topology]] + - [[read]] [[category theory]] + - measures/metrics for 'distance to isomorphism'? + - e.g. measures of information loss in transforms + - seems to map to complexity of convergence in computation / difficulty to [[merge]] - [[topology]] - Write about [[excursion]]. - [[onkyo volume]] From 4cf3d01ad58ab06375f8c0bd24ce235298c7af43 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 18:49:07 +0200 Subject: [PATCH 03/17] Default commit message, part of an automated flow. --- arcologies.md | 9 +-------- arcology.md | 10 ++++++++++ journal/2021-08-14.md | 1 + 3 files changed, 12 insertions(+), 8 deletions(-) diff --git a/arcologies.md b/arcologies.md index 58979630f..cdcc9a9cc 100644 --- a/arcologies.md +++ b/arcologies.md @@ -1,11 +1,4 @@ -- [[wp]] https://en.wikipedia.org/wiki/Arcology - - [[go]] [[wp]] - - ever since I played [[simcity 2000]] I have liked them. - - [[solarpunk]] - - [[cyberpunk]] - - [[sci fi]] - - [[paolo soleri]] - - [[kenzo tange]] +- [[pull]] [[arcology]] - a [[list]] - [[launch]] - [[plymouth]] diff --git a/arcology.md b/arcology.md index 9046daa1c..25f4b576a 100644 --- a/arcology.md +++ b/arcology.md @@ -1 +1,11 @@ +- a [[technology]] - [[pull]] [[arcologies]] +- [[wp]] https://en.wikipedia.org/wiki/Arcology + - [[go]] [[wp]] +- ever since I played [[simcity 2000]] I have liked them. +- [[solarpunk]] +- [[cyberpunk]] +- [[sci fi]] +- [[paolo soleri]] +- [[kenzo tange]] + diff --git a/journal/2021-08-14.md b/journal/2021-08-14.md index 9fa3b5559..2f1992ed9 100644 --- a/journal/2021-08-14.md +++ b/journal/2021-08-14.md @@ -11,6 +11,7 @@ - [[vanna white]] - [[defcon]] - [[defcon radio]] +- [[arcologies]] - [[do]] - [[push]] [[later]] - [[slay moloch]] From 7e6228f98e51735840bca583e0b6ab40310d7804 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 18:52:48 +0200 Subject: [PATCH 04/17] Default commit message, part of an automated flow. --- arcologies.md | 12 +++++++----- simcity 2000.md | 6 ++++++ 2 files changed, 13 insertions(+), 5 deletions(-) create mode 100644 simcity 2000.md diff --git a/arcologies.md b/arcologies.md index cdcc9a9cc..eb272ea4b 100644 --- a/arcologies.md +++ b/arcologies.md @@ -1,13 +1,15 @@ - [[pull]] [[arcology]] - a [[list]] - - [[launch]] - - [[plymouth]] - - [[forest]] - - [[darco]] + - https://twitter.com/flancian/status/1393939171958476803 + - [[simcity 2000]] + - [[launch]] + - [[plymouth]] + - [[forest]] + - [[darco]] - [[arcosanti]] - [[kowloon walled city]] - [[begich towers]] - [[kraftwerk 1]] -https://twitter.com/flancian/status/1393939171958476803 + ![[arcology.jpg]] \ No newline at end of file diff --git a/simcity 2000.md b/simcity 2000.md new file mode 100644 index 000000000..db41fd92c --- /dev/null +++ b/simcity 2000.md @@ -0,0 +1,6 @@ +# simcity 2000 + +- a [[game]] + - I played it a *lot* when I was a kid + - [[go]] https://medium.com/@LeavittAlone/sim-city-2k-post-capitalism-and-the-four-futures-b21de83381f7 + From d9de805746aa1c11f87845ff306088757711dc37 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 18:53:27 +0200 Subject: [PATCH 05/17] Default commit message, part of an automated flow. --- arcologies.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/arcologies.md b/arcologies.md index eb272ea4b..620f5b2d7 100644 --- a/arcologies.md +++ b/arcologies.md @@ -1,7 +1,7 @@ - [[pull]] [[arcology]] - a [[list]] - https://twitter.com/flancian/status/1393939171958476803 - - [[simcity 2000]] + - [[simcity 2000]] https://medium.com/@LeavittAlone/sim-city-2k-post-capitalism-and-the-four-futures-b21de83381f7 - [[launch]] - [[plymouth]] - [[forest]] From 59d85a8297238bcd937079ae4f3ac622079c8fc5 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 18:57:15 +0200 Subject: [PATCH 06/17] Default commit message, part of an automated flow. --- later.md | 4 +++- tweets.md | 2 +- 2 files changed, 4 insertions(+), 2 deletions(-) diff --git a/later.md b/later.md index 7c05abc77..2f9708d1b 100644 --- a/later.md +++ b/later.md @@ -41,11 +41,13 @@ - [[clipboard sync]] - [[tweets]] - [[wayland]] -- [[done]] +- [[push]] [[done]] - [[listen]] audio messages - [[jonathan]] - [[friends]] - [[family]] +- push done should elide from source, clean up, collapse/zip + diff --git a/tweets.md b/tweets.md index 6cf613548..eac36c4fe 100644 --- a/tweets.md +++ b/tweets.md @@ -56,4 +56,4 @@ I think I might have found the way to simulate myself, at least while I'm sittin - There is a word for an entity that embeds itself in another, takes energy or information and doesn't give back in kind. It's also a hit 2019 movie. -- \ No newline at end of file +- Whenever I find something, I ask myself: how can we use this to [[slay moloch]]? \ No newline at end of file From 83e4ad7be2d675429516b7f28d54bb9dd2ab75f5 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 19:00:53 +0200 Subject: [PATCH 07/17] Default commit message, part of an automated flow. --- tweets.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/tweets.md b/tweets.md index eac36c4fe..466f0c662 100644 --- a/tweets.md +++ b/tweets.md @@ -56,4 +56,8 @@ I think I might have found the way to simulate myself, at least while I'm sittin - There is a word for an entity that embeds itself in another, takes energy or information and doesn't give back in kind. It's also a hit 2019 movie. -- Whenever I find something, I ask myself: how can we use this to [[slay moloch]]? \ No newline at end of file +- Whenever I find something, I ask myself: how can we use this to [[slay moloch]]? + +- on [[building]]. + - I think we should [[build more bridges]]. + - I think we should [[build pyramids]], but under one condition only: each 1x1m cubic block we add to them (Minecraft like) maps to every human being that died without having gotten the necessary living conditions to [[thrive]]. \ No newline at end of file From dd8ac7fb0199f10d55865351a850cc85c1d49697 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 19:01:16 +0200 Subject: [PATCH 08/17] Default commit message, part of an automated flow. --- tweets.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/tweets.md b/tweets.md index 466f0c662..c41aa429e 100644 --- a/tweets.md +++ b/tweets.md @@ -60,4 +60,4 @@ I think I might have found the way to simulate myself, at least while I'm sittin - on [[building]]. - I think we should [[build more bridges]]. - - I think we should [[build pyramids]], but under one condition only: each 1x1m cubic block we add to them (Minecraft like) maps to every human being that died without having gotten the necessary living conditions to [[thrive]]. \ No newline at end of file + - I think we should [[build pyramids]], but under one condition only: each unit block we add to them (Minecraft like) maps to every human being that died without having gotten the necessary living conditions to [[thrive]]. \ No newline at end of file From c58eb10255cfd47bb44fb015299464003e83d3b0 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 19:02:53 +0200 Subject: [PATCH 09/17] Default commit message, part of an automated flow. --- build pyramids.md | 4 ++++ tweets.md | 2 +- 2 files changed, 5 insertions(+), 1 deletion(-) create mode 100644 build pyramids.md diff --git a/build pyramids.md b/build pyramids.md new file mode 100644 index 000000000..ca0a6865d --- /dev/null +++ b/build pyramids.md @@ -0,0 +1,4 @@ +# build pyramids + +- I think we should [[build pyramids]], but under one condition only: each unit block we add to them (Minecraft like) maps to a human being that died without having gotten the necessary living conditions to [[thrive]] in some region of the universe. + diff --git a/tweets.md b/tweets.md index c41aa429e..02761115a 100644 --- a/tweets.md +++ b/tweets.md @@ -60,4 +60,4 @@ I think I might have found the way to simulate myself, at least while I'm sittin - on [[building]]. - I think we should [[build more bridges]]. - - I think we should [[build pyramids]], but under one condition only: each unit block we add to them (Minecraft like) maps to every human being that died without having gotten the necessary living conditions to [[thrive]]. \ No newline at end of file + - I think we should [[build pyramids]], but under one condition only: each unit block we add to them (Minecraft like) maps to a human being that died without having gotten the necessary living conditions to [[thrive]] in some region of the universe. \ No newline at end of file From 6dd2fb757e6d91f494649ebd94676973e34a04d5 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 20:16:25 +0200 Subject: [PATCH 10/17] Default commit message, part of an automated flow. --- async search.md | 1 + before and after cache.md | 100 ++++++++++++++++++++++++++++++++++++++ 2 files changed, 101 insertions(+) create mode 100644 before and after cache.md diff --git a/async search.md b/async search.md index 846bff9ec..14851663e 100644 --- a/async search.md +++ b/async search.md @@ -7,6 +7,7 @@ - `ab -n 100 -c 10 https://1.anagora.org/index` - ~10 seconds overall, 50% ~0.6 seconds, 99% ~2 seconds - on localhost (dev instance) the 99% goes up to 50-60 seconds, there are clear hangs. + - [[before and after cache]] - testing after disabling full text search: - on localhost (dev instance) the 99% goes down to 3-6s (!). as expected, but nice to see. diff --git a/before and after cache.md b/before and after cache.md new file mode 100644 index 000000000..f7a706c1a --- /dev/null +++ b/before and after cache.md @@ -0,0 +1,100 @@ +# before and after cache + +- before [[cache]] +``` +This is ApacheBench, Version 2.3 <$Revision: 1879490 $> +Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ +Licensed to The Apache Software Foundation, http://www.apache.org/ + +Benchmarking 1.anagora.org (be patient).....done + + +Server Software: nginx/1.14.2 +Server Hostname: 1.anagora.org +Server Port: 443 +SSL/TLS Protocol: TLSv1.2,ECDHE-RSA-CHACHA20-POLY1305,2048,256 +Server Temp Key: X25519 253 bits +TLS Server Name: 1.anagora.org + +Document Path: /index +Document Length: 86661 bytes + +Concurrency Level: 10 +Time taken for tests: 8.594 seconds +Complete requests: 100 +Failed requests: 0 +Total transferred: 8685300 bytes +HTML transferred: 8666100 bytes +Requests per second: 11.64 [#/sec] (mean) +Time per request: 859.357 [ms] (mean) +Time per request: 85.936 [ms] (mean, across all concurrent requests) +Transfer rate: 986.99 [Kbytes/sec] received + +Connection Times (ms) + min mean[+/-sd] median max +Connect: 83 86 4.7 85 118 +Processing: 508 709 387.8 615 2408 +Waiting: 394 596 387.8 502 2295 +Total: 591 794 389.3 700 2497 + +Percentage of the requests served within a certain time (ms) + 50% 700 + 66% 726 + 75% 743 + 80% 751 + 90% 782 + 95% 1816 + 98% 2471 + 99% 2497 + 100% 2497 (longest request) +``` + +- after [[caching]] +``` +flancian@paramita:/etc/nginx/sites-enabled$ ab -n 100 -c 10 https://1.anagora.org/index +This is ApacheBench, Version 2.3 <$Revision: 1879490 $> +Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ +Licensed to The Apache Software Foundation, http://www.apache.org/ + +Benchmarking 1.anagora.org (be patient).....done + + +Server Software: nginx/1.14.2 +Server Hostname: 1.anagora.org +Server Port: 443 +SSL/TLS Protocol: TLSv1.2,ECDHE-RSA-CHACHA20-POLY1305,2048,256 +Server Temp Key: X25519 253 bits +TLS Server Name: 1.anagora.org + +Document Path: /index +Document Length: 86661 bytes + +Concurrency Level: 10 +Time taken for tests: 2.709 seconds +Complete requests: 100 +Failed requests: 0 +Total transferred: 8685300 bytes +HTML transferred: 8666100 bytes +Requests per second: 36.91 [#/sec] (mean) +Time per request: 270.912 [ms] (mean) +Time per request: 27.091 [ms] (mean, across all concurrent requests) +Transfer rate: 3130.81 [Kbytes/sec] received + +Connection Times (ms) + min mean[+/-sd] median max +Connect: 83 85 1.7 85 91 +Processing: 164 170 4.2 169 194 +Waiting: 54 56 1.2 55 61 +Total: 248 255 4.8 254 279 + +Percentage of the requests served within a certain time (ms) + 50% 254 + 66% 256 + 75% 258 + 80% 258 + 90% 261 + 95% 265 + 98% 266 + 99% 279 + 100% 279 (longest request) +``` \ No newline at end of file From 9eefc5c772177de1370508ca21645f29e6b01e37 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 20:26:50 +0200 Subject: [PATCH 11/17] Default commit message, part of an automated flow. --- before and after cache.md | 44 +++++++++++++++++++-------------------- 1 file changed, 22 insertions(+), 22 deletions(-) diff --git a/before and after cache.md b/before and after cache.md index f7a706c1a..1870bd17e 100644 --- a/before and after cache.md +++ b/before and after cache.md @@ -49,7 +49,7 @@ Percentage of the requests served within a certain time (ms) 100% 2497 (longest request) ``` -- after [[caching]] +- after [[nginx caching]] ``` flancian@paramita:/etc/nginx/sites-enabled$ ab -n 100 -c 10 https://1.anagora.org/index This is ApacheBench, Version 2.3 <$Revision: 1879490 $> @@ -67,34 +67,34 @@ Server Temp Key: X25519 253 bits TLS Server Name: 1.anagora.org Document Path: /index -Document Length: 86661 bytes +Document Length: 86773 bytes Concurrency Level: 10 -Time taken for tests: 2.709 seconds +Time taken for tests: 2.907 seconds Complete requests: 100 Failed requests: 0 -Total transferred: 8685300 bytes -HTML transferred: 8666100 bytes -Requests per second: 36.91 [#/sec] (mean) -Time per request: 270.912 [ms] (mean) -Time per request: 27.091 [ms] (mean, across all concurrent requests) -Transfer rate: 3130.81 [Kbytes/sec] received +Total transferred: 8696500 bytes +HTML transferred: 8677300 bytes +Requests per second: 34.39 [#/sec] (mean) +Time per request: 290.748 [ms] (mean) +Time per request: 29.075 [ms] (mean, across all concurrent requests) +Transfer rate: 2920.98 [Kbytes/sec] received Connection Times (ms) min mean[+/-sd] median max -Connect: 83 85 1.7 85 91 -Processing: 164 170 4.2 169 194 -Waiting: 54 56 1.2 55 61 -Total: 248 255 4.8 254 279 +Connect: 83 87 11.4 85 196 +Processing: 165 171 6.8 170 208 +Waiting: 54 56 2.2 56 65 +Total: 249 259 13.7 255 364 Percentage of the requests served within a certain time (ms) - 50% 254 - 66% 256 - 75% 258 - 80% 258 - 90% 261 - 95% 265 - 98% 266 - 99% 279 - 100% 279 (longest request) + 50% 255 + 66% 257 + 75% 260 + 80% 262 + 90% 275 + 95% 276 + 98% 303 + 99% 364 + 100% 364 (longest request) ``` \ No newline at end of file From 4997771183f9608be363ff43dbd646a8964636a0 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 20:32:18 +0200 Subject: [PATCH 12/17] Default commit message, part of an automated flow. --- nginx caching.md | 22 ++++++++++++++++++++++ 1 file changed, 22 insertions(+) create mode 100644 nginx caching.md diff --git a/nginx caching.md b/nginx caching.md new file mode 100644 index 000000000..5b3b3e940 --- /dev/null +++ b/nginx caching.md @@ -0,0 +1,22 @@ +# nginx caching + +- [[2021-08-14]] + - added this to nginx.conf in http scope: + +``` + uwsgi_cache_valid any 30s; + uwsgi_cache_path /tmp/agora-cache keys_zone=agora-cache:1000m; +``` + +- [[2021-08-14]] + - and this is what the [[agora]]'s `location` looks like in the virtual host: + +``` + location / { + uwsgi_cache agora-cache; + uwsgi_cache_key $scheme$host$request_uri; + include uwsgi_params; + # /home/agora/agora-server/run-prod.sh to run. + uwsgi_pass unix:/tmp/agora-uwsgi.sock; + } +``` \ No newline at end of file From f32aa834fc5199197b17f311cb4a0644c8fb9509 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 20:32:48 +0200 Subject: [PATCH 13/17] Default commit message, part of an automated flow. --- nginx caching.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/nginx caching.md b/nginx caching.md index 5b3b3e940..61e18b5d6 100644 --- a/nginx caching.md +++ b/nginx caching.md @@ -1,6 +1,6 @@ # nginx caching -- [[2021-08-14]] +- [[push]] [[agora server]] - added this to nginx.conf in http scope: ``` @@ -8,7 +8,7 @@ uwsgi_cache_path /tmp/agora-cache keys_zone=agora-cache:1000m; ``` -- [[2021-08-14]] +- [[push]] [[agora server]] - and this is what the [[agora]]'s `location` looks like in the virtual host: ``` From 4051d3a68f17375472c9721893ba2dbb354b6afd Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 20:37:23 +0200 Subject: [PATCH 14/17] Default commit message, part of an automated flow. --- before and after cache.md | 100 ++++++++++++++++++++++++++++++++++++++ 1 file changed, 100 insertions(+) diff --git a/before and after cache.md b/before and after cache.md index 1870bd17e..c0412d074 100644 --- a/before and after cache.md +++ b/before and after cache.md @@ -97,4 +97,104 @@ Percentage of the requests served within a certain time (ms) 98% 303 99% 364 100% 364 (longest request) +``` + +- in [[thecla]], before and after for same config change, with [[async search]] already deployed + +``` +flancian@paramita:/etc/nginx/sites-enabled$ ab -n 100 -c 10 https://anagora.org/index +This is ApacheBench, Version 2.3 <$Revision: 1879490 $> +Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ +Licensed to The Apache Software Foundation, http://www.apache.org/ + +Benchmarking anagora.org (be patient).....done + + +Server Software: nginx/1.14.2 +Server Hostname: anagora.org +Server Port: 443 +SSL/TLS Protocol: TLSv1.2,ECDHE-RSA-CHACHA20-POLY1305,2048,256 +Server Temp Key: X25519 253 bits +TLS Server Name: anagora.org + +Document Path: /index +Document Length: 42600 bytes + +Concurrency Level: 10 +Time taken for tests: 8.310 seconds +Complete requests: 100 +Failed requests: 0 +Total transferred: 4279200 bytes +HTML transferred: 4260000 bytes +Requests per second: 12.03 [#/sec] (mean) +Time per request: 830.959 [ms] (mean) +Time per request: 83.096 [ms] (mean, across all concurrent requests) +Transfer rate: 502.90 [Kbytes/sec] received + +Connection Times (ms) + min mean[+/-sd] median max +Connect: 63 66 2.8 65 76 +Processing: 313 716 772.1 431 3046 +Waiting: 312 715 772.2 430 3045 +Total: 378 782 773.8 496 3120 + +Percentage of the requests served within a certain time (ms) + 50% 496 + 66% 528 + 75% 538 + 80% 554 + 90% 2674 + 95% 2885 + 98% 3018 + 99% 3120 + 100% 3120 (longest request) +``` + +``` +flancian@paramita:/etc/nginx/sites-enabled$ ab -n 100 -c 10 https://anagora.org/index +This is ApacheBench, Version 2.3 <$Revision: 1879490 $> +Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ +Licensed to The Apache Software Foundation, http://www.apache.org/ + +Benchmarking anagora.org (be patient).....done + + +Server Software: nginx/1.14.2 +Server Hostname: anagora.org +Server Port: 443 +SSL/TLS Protocol: TLSv1.2,ECDHE-RSA-CHACHA20-POLY1305,2048,256 +Server Temp Key: X25519 253 bits +TLS Server Name: anagora.org + +Document Path: /index +Document Length: 42600 bytes + +Concurrency Level: 10 +Time taken for tests: 1.352 seconds +Complete requests: 100 +Failed requests: 0 +Total transferred: 4279200 bytes +HTML transferred: 4260000 bytes +Requests per second: 73.96 [#/sec] (mean) +Time per request: 135.205 [ms] (mean) +Time per request: 13.521 [ms] (mean, across all concurrent requests) +Transfer rate: 3090.79 [Kbytes/sec] received + +Connection Times (ms) + min mean[+/-sd] median max +Connect: 63 67 3.1 67 80 +Processing: 42 52 38.3 44 393 +Waiting: 40 46 12.2 42 95 +Total: 105 120 38.2 111 458 + +Percentage of the requests served within a certain time (ms) + 50% 111 + 66% 112 + 75% 114 + 80% 117 + 90% 143 + 95% 153 + 98% 215 + 99% 458 + 100% 458 (longest request) ``` \ No newline at end of file From 7c127da775f5d2269a75ac6c71756fe4b452afa4 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 20:39:54 +0200 Subject: [PATCH 15/17] Default commit message, part of an automated flow. --- before and after cache.md | 6 +++--- uwsgi caching.md | 5 +++++ 2 files changed, 8 insertions(+), 3 deletions(-) create mode 100644 uwsgi caching.md diff --git a/before and after cache.md b/before and after cache.md index c0412d074..f87d9734e 100644 --- a/before and after cache.md +++ b/before and after cache.md @@ -1,6 +1,6 @@ # before and after cache -- before [[cache]] +- before [[cache]] as of [[2021-08-14]]: ``` This is ApacheBench, Version 2.3 <$Revision: 1879490 $> Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ @@ -49,7 +49,7 @@ Percentage of the requests served within a certain time (ms) 100% 2497 (longest request) ``` -- after [[nginx caching]] +- after adding [[nginx caching]] / [[uwsgi caching]]: ``` flancian@paramita:/etc/nginx/sites-enabled$ ab -n 100 -c 10 https://1.anagora.org/index This is ApacheBench, Version 2.3 <$Revision: 1879490 $> @@ -99,7 +99,7 @@ Percentage of the requests served within a certain time (ms) 100% 364 (longest request) ``` -- in [[thecla]], before and after for same config change, with [[async search]] already deployed +- in [[thecla]], before and after for same config change, with [[async search]] already deployed: ``` flancian@paramita:/etc/nginx/sites-enabled$ ab -n 100 -c 10 https://anagora.org/index diff --git a/uwsgi caching.md b/uwsgi caching.md new file mode 100644 index 000000000..da24957d6 --- /dev/null +++ b/uwsgi caching.md @@ -0,0 +1,5 @@ +# uwsgi caching + +- [[pull]] [[nginx caching]] + - [[uwsgi]] is what [[agora server]] users ([[Python]] middleware). + From a3fbf86b29a341382ed24cabaed0f0105b193183 Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 20:42:20 +0200 Subject: [PATCH 16/17] Default commit message, part of an automated flow. --- async search.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/async search.md b/async search.md index 14851663e..8f85995d8 100644 --- a/async search.md +++ b/async search.md @@ -1,6 +1,6 @@ # async search -- search currently happens in every node, and it's full text search. this is very costly, I knew when adding it but it was just too convenient. +- search currently happens in every node by default, and it's full text (regex even) search. this is very costly, I knew when adding it but it was just too convenient and useful to have it :) - today on [[2021-08-14]] I'll try to fix this by making search be an async action: search only triggers when users reach the bottom of the page or request searching explicitly. - this will have the nice side effect of making the agora cheap by default when servicing bot requests, which probably won't run the javascript that is needed to retrieve search. - initial testing with `ab` (I know, old school) @@ -10,4 +10,6 @@ - [[before and after cache]] - testing after disabling full text search: - on localhost (dev instance) the 99% goes down to 3-6s (!). as expected, but nice to see. +- this didn't end up being enough to fix significant spikes of latency in high percentiles, so added [[uwsgi caching]] also. + - see [[before and after cache]] From 8e5098fc950ef41d35a9704c320f82c488acc87d Mon Sep 17 00:00:00 2001 From: Flancian <0@flancia.org> Date: Sat, 14 Aug 2021 20:43:37 +0200 Subject: [PATCH 17/17] Default commit message, part of an automated flow. --- nginx caching.md | 1 + 1 file changed, 1 insertion(+) diff --git a/nginx caching.md b/nginx caching.md index 61e18b5d6..58fe8395d 100644 --- a/nginx caching.md +++ b/nginx caching.md @@ -1,6 +1,7 @@ # nginx caching - [[push]] [[agora server]] + - [[pull]] [[before and after cache]] - added this to nginx.conf in http scope: ```