{"id":78,"date":"2015-11-29T18:02:10","date_gmt":"2015-11-29T16:02:10","guid":{"rendered":"http:\/\/mattyb.co.za\/?p=78"},"modified":"2015-11-29T18:02:10","modified_gmt":"2015-11-29T16:02:10","slug":"wait","status":"publish","type":"post","link":"https:\/\/mattyb.co.za\/index.php\/2015\/11\/29\/wait\/","title":{"rendered":"WAIT!"},"content":{"rendered":"<p>Who wants to wait around for other people\/things?<\/p>\n<p>Defiantly not your cache server, and if it is waiting around, then there could be a problem somewhere.<\/p>\n<p>See my case below:<a href=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/kern1z.1day.png\"><img loading=\"lazy\" decoding=\"async\" data-attachment-id=\"80\" data-permalink=\"https:\/\/mattyb.co.za\/index.php\/2015\/11\/29\/wait\/system1z-1day-2\/\" data-orig-file=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/system1z.1day.png?fit=897%2C370&amp;ssl=1\" data-orig-size=\"897,370\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"system1z.1day\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/system1z.1day.png?fit=300%2C124&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/system1z.1day.png?fit=604%2C249&amp;ssl=1\" class=\"aligncenter size-full wp-image-80\" src=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/system1z.1day.png?resize=604%2C249\" alt=\"system1z.1day\" width=\"604\" height=\"249\" srcset=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/system1z.1day.png?w=897&amp;ssl=1 897w, https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/system1z.1day.png?resize=300%2C124&amp;ssl=1 300w\" sizes=\"auto, (max-width: 604px) 100vw, 604px\" data-recalc-dims=\"1\" \/><\/a><a href=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/kern1z.1day.png\"><img loading=\"lazy\" decoding=\"async\" data-attachment-id=\"79\" data-permalink=\"https:\/\/mattyb.co.za\/index.php\/2015\/11\/29\/wait\/kern1z-1day\/\" data-orig-file=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/kern1z.1day.png?fit=897%2C370&amp;ssl=1\" data-orig-size=\"897,370\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"kern1z.1day\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/kern1z.1day.png?fit=300%2C124&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/kern1z.1day.png?fit=604%2C249&amp;ssl=1\" class=\"aligncenter size-full wp-image-79\" src=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/kern1z.1day.png?resize=604%2C249\" alt=\"kern1z.1day\" width=\"604\" height=\"249\" srcset=\"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/kern1z.1day.png?w=897&amp;ssl=1 897w, https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/11\/kern1z.1day.png?resize=300%2C124&amp;ssl=1 300w\" sizes=\"auto, (max-width: 604px) 100vw, 604px\" data-recalc-dims=\"1\" \/><\/a><br \/>\nThe server has only 4 CPUs, and its load average is almost double that.<br \/>\nWow, why is there so much work happening on the CPU? What is could it be processing that is causing such high load?<\/p>\n<p>Nothing. The Answer is ZERO.<br \/>\nIt isn&#8217;t doing a thing, but it is rather, waiting.<\/p>\n<p>If you take a look at the Kernal Usage graph, we see that we are waiting. A lot. This is due to the disks in this high-demand cache really not being able to fit the load its expected to do, serve a lot of content to a country of users.<\/p>\n<p>Poor thing.<\/p>\n<p>As it stands this box has 3 x 3TB Drives in it. Striped for ghaddagofast speeds. But it still isn&#8217;t enough. It would seem like the actual transfer rates are okay, and don&#8217;t seem to be a bottleneck, but rather the IOps they are expected to be able to serve.<\/p>\n<p>This problem could be EASILY solved with 1 x SSD. Seriously easily, and a little $$.<br \/>\nBut $$ isn&#8217;t always on your side. People like their $$$.<\/p>\n<p>So we have to use what is around, which in this case is alot of servers and magnetic drives.<\/p>\n<p>Cool, we can just pop some more HDDs into the server, cant we?<br \/>\nWrong.<\/p>\n<p>The server is 1U big with 3 bays as is. There is no space.<\/p>\n<p>So now, we plan stuff. We need to make a plan. Or we scrap the project.<\/p>\n<p>So we get 2 x of the Old servers.<br \/>\nThese can take 3 x Drives each. We populate the bays.<\/p>\n<p>We then install FreeNAS, because I quite enjoy using it and it sends me emails, which I quite like.<br \/>\nIt also supports iSCSI, which we plan to use to share the drives over 2 x 1Gbps NICs.<\/p>\n<p><em><b>iSCSI<\/b>, which stands for Internet Small Computer System Interface, works on top of the Transport Control Protocol (TCP) and allows the SCSI command to be sent end-to-end over local-area networks (LANs), wide-area networks (WANs) or the Internet.<\/p>\n<p><\/em>Will it work? I hope so. If it doesnt work after this, that really is kinda sucky.<\/p>\n<p>Time will tell, right?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Who wants to wait around for other people\/things? Defiantly not your cache server, and if it is waiting around, then there could be a problem somewhere. See my case below: The server has only 4 CPUs, and its load average is almost double that. Wow, why is there so much work happening on the CPU? &hellip; <a href=\"https:\/\/mattyb.co.za\/index.php\/2015\/11\/29\/wait\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">WAIT!<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[1],"tags":[],"class_list":["post-78","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/s71fL2-wait","jetpack-related-posts":[{"id":6,"url":"https:\/\/mattyb.co.za\/index.php\/2015\/09\/26\/rage-lan-2015\/","url_meta":{"origin":78,"position":0},"title":"rAge LAN 2015 Post 1","author":"admin","date":"September 26, 2015","format":false,"excerpt":"So I am a part of building the NAG LAN at the biggest Gaming Expo in South Africa. rAge My main purpose at the event will be to set-up the the LAN cache, as done here by Multiplay. I have 2 x the below to work with: 2 x Intel\u2026","rel":"","context":"In &quot;rAge 2015&quot;","block_context":{"text":"rAge 2015","link":"https:\/\/mattyb.co.za\/index.php\/category\/rage-2015\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":90,"url":"https:\/\/mattyb.co.za\/index.php\/2016\/03\/09\/rage-cape-town-2016\/","url_meta":{"origin":78,"position":1},"title":"rAge Cape Town 2016","author":"admin","date":"March 9, 2016","format":false,"excerpt":"So, with the event fast approaching, planning is well under way for rAge Cape Town 2016. Sadly since the event is fairly\u00a0small this year, with only a few hundred gamers, which means there is a limited budget. This is still okay, I will be paying my way and heading down\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.rageexpo.co.za\/wp-content\/media\/rage-website-header-banner20457.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.rageexpo.co.za\/wp-content\/media\/rage-website-header-banner20457.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.rageexpo.co.za\/wp-content\/media\/rage-website-header-banner20457.jpg?resize=700%2C400 2x"},"classes":[]},{"id":21,"url":"https:\/\/mattyb.co.za\/index.php\/2015\/10\/13\/rage-2015-the-stats\/","url_meta":{"origin":78,"position":2},"title":"rAge 2015 &#8211; The stats","author":"admin","date":"October 13, 2015","format":false,"excerpt":"So, stats from the SteamCache at rAge 2015 16.4TB was recieced through the internet IP, and 51.1TB was sent out by the cache's Steam IP. The highest peak of traffic to the cache from the LAN bond, was 10.07Gbps, on Friday morning. The max tracked connections to the cache was\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"system1z.1day","src":"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/10\/system1z.1day.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/10\/system1z.1day.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/mattyb.co.za\/wp-content\/uploads\/2015\/10\/system1z.1day.png?resize=700%2C400 2x"},"classes":[]},{"id":129,"url":"https:\/\/mattyb.co.za\/index.php\/2018\/01\/20\/cpanel-nginx-hack-mirror-sometimes-breaks\/","url_meta":{"origin":78,"position":3},"title":"CPanel NGINX hack-mirror, sometimes breaks","author":"admin","date":"January 20, 2018","format":false,"excerpt":"We had a few clients complaining about corrupted downloads from our mirror when trying to run upcp CPanel update, so I checked it out. It looks like the NGINX Proxy Cache had corruption, and it had a file \"http:\/\/cpproxy.afrixx.com\/cpanelsync\/11.68.0.26\/binaries\/linux-c7-x86_64\/bin\/setsiteip.xz\" that was invalid, and corrupted based on the expected checksum. I've\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":16,"url":"https:\/\/mattyb.co.za\/index.php\/2015\/09\/30\/rage-2015-post-3\/","url_meta":{"origin":78,"position":4},"title":"rAge 2015 Post 3","author":"admin","date":"September 30, 2015","format":false,"excerpt":"Today we add nginx to out Monitorix, and install BandwidthD\u00a0for extra bandwidth monitoring. I would like to see who our biggest bandwidth movers are. I use\u00a0bandwidthd on a few PFSense boxes I run, and I love the way it works :) Nginx seems to have its own monitoring running on\u2026","rel":"","context":"In &quot;rAge 2015&quot;","block_context":{"text":"rAge 2015","link":"https:\/\/mattyb.co.za\/index.php\/category\/rage-2015\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":72,"url":"https:\/\/mattyb.co.za\/index.php\/2015\/11\/12\/the-bigger-scope-of-things\/","url_meta":{"origin":78,"position":5},"title":"The bigger scope of things.","author":"admin","date":"November 12, 2015","format":false,"excerpt":"Sometimes, we can use allll of the IPs, we don't get the luxury of having an infinite amount available, and we need to make do with ONE IP. Well, NGINX doesnt stress about that, we just need to set it up. Nginx will take a look at the Host Headers,\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/posts\/78","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/comments?post=78"}],"version-history":[{"count":1,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/posts\/78\/revisions"}],"predecessor-version":[{"id":81,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/posts\/78\/revisions\/81"}],"wp:attachment":[{"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/media?parent=78"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/categories?post=78"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mattyb.co.za\/index.php\/wp-json\/wp\/v2\/tags?post=78"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}