{"id":1659,"date":"2023-09-26T06:30:00","date_gmt":"2023-09-26T10:30:00","guid":{"rendered":"http:\/\/192.168.1.40\/?p=1659"},"modified":"2024-04-09T11:04:26","modified_gmt":"2024-04-09T15:04:26","slug":"learn-how-to-scale-kubernetes","status":"publish","type":"post","link":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/","title":{"rendered":"Scale Kubernetes and Boost Performance"},"content":{"rendered":"\n<p>Kubernetes Bottlenecks Exposed! Optimize, Boost Performance, and Scale. In this episode, we take each component of Kubernetes and determine how to make it scale.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Kubernetes Bottlenecks Exposed! Optimize,  Boost Performance, and Scale\" width=\"1080\" height=\"608\" src=\"https:\/\/www.youtube.com\/embed\/Wyfv0jiPsvA?feature=oembed\"  allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>In this episode, we take each component of Kubernetes and determine how to make it scale. Scott interviews the CTO of PerfectScale on how to optimize Kubernetes deployed applications.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Key Video Insights on How To Scale Kubernetes<\/h2>\n\n\n\n<p>\ud83d\udcb8 Over-provisioning in Kubernetes clusters leads to unnecessary expenses and is a common problem for many organizations.<\/p>\n\n\n\n<p>\ud83e\udd14 Performance engineers need to look at every layer of Kubernetes to identify weak points and optimize resource allocation for better performance.<\/p>\n\n\n\n<p>\ud83d\udee0\ufe0f The orchestrator in Kubernetes ensures that all applications have enough resources on the same machine, preventing overconsumption and ensuring efficient allocation.<\/p>\n\n\n\n<p>\ud83e\udde0 The memory limit in Kubernetes acts as a safety valve for applications, preventing the entire machine from being killed.<\/p>\n\n\n\n<p>\ud83e\udd16 Using proprietary AI-driven algorithms to optimize application performance and cost in Kubernetes deployments maybe the future.<\/p>\n\n\n\n<p>Check out <a href=\"http:\/\/192.168.1.40\/episode\/episode-048-load-testing-kubernetes-with-traffic-replay\/\">this other video<\/a> on load testing Kubernetes with traffic replay. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Show Notes<\/h2>\n\n\n\n<p><strong>GUEST:<\/strong> Eli Birger<br><strong>LINKEDIN PROFILE:<\/strong> <a href=\"https:\/\/www.linkedin.com\/in\/eli-birger-44aa8717\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.linkedin.com\/in\/eli-birger-44aa8717\/<\/a><\/p>\n\n\n\n<p>Perfect Scale: <a href=\"https:\/\/www.perfectscale.io\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.perfectscale.io\/<\/a><\/p>\n\n\n\n<p>OpenAI &#8211; Scaling Kubernetes to 7500 Nodes: <a href=\"https:\/\/openai.com\/research\/scaling-kubernetes-to-7500-nodes\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/openai.com\/research\/scaling-kubernetes-to-7500-nodes<\/a><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">How to Scale Kubernetes<\/h2>\n\n\n\n<p>To verify the scalability and performance of the Kubernetes architecture, you can load test each component separately. Here are some guidelines for load testing each component:<\/p>\n\n\n\n<p><strong>Control Plane:<\/strong><\/p>\n\n\n\n<ul>\n<li><strong>API Server<\/strong>: You can simulate a high number of API requests and verify the response time and throughput. You can also test how the API server behaves under high concurrency and load balancing scenarios.<\/li>\n\n\n\n<li><strong>etcd:<\/strong> You can perform read and write operations to the etcd store and measure the response time and throughput. You can also test how etcd behaves under different load levels and data volumes.<\/li>\n\n\n\n<li><strong>Controller Manager:<\/strong> You can test how the controller manager responds to changes in the cluster&#8217;s state and how it manages different controllers. You can also test how it behaves under high load scenarios.<\/li>\n\n\n\n<li><strong>Scheduler:<\/strong> You can test how the scheduler schedules containers onto nodes and how it responds to changes in resource availability. You can also test how it behaves under high load scenarios.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Sponsors<\/h2>\n\n\n\n<p>This podcast is sponsored by Saltworks Security. For almost 10 years, Saltworks Security has delivered world class application security services and products, designed to help enterprises secure their applications from policy to production in an ever-changing security landscape. They are the makers of Saltworks SaltMiner, an application security management platform, designed by security professionals, for security professionals.<\/p>\n\n\n\n<p>SaltMiner aggregates and normalizes issues found by many different solutions then enriches that data with business context. SaltMiner gives team members from the C-suite, security and development teams the ability to manage their application security program through customizable views.<\/p>\n\n\n\n<p>The Saltworks SaltMiner Community Edition is a free Penetration Testing Management and Delivery application. It provides teams with custom reporting for potentially thousands of end users, red team support and the ability to manage new and retesting of engagements. SaltMiner Community Edition also allows teams to enforce both testing methodologies and custom vulnerability databases for consistency in engagement delivery.<\/p>\n\n\n\n<p><a href=\"https:\/\/bit.ly\/smcsaltworks\">https:\/\/bit.ly\/smcsaltworks<\/a><\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"512\" height=\"512\" src=\"http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/04\/qr_smcsaltworks.png\" alt=\"saltworks security scale kubernetes\" class=\"wp-image-1502\" style=\"width:382px;height:382px\" srcset=\"http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/04\/qr_smcsaltworks.png 512w, http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/04\/qr_smcsaltworks-480x480.png 480w\" sizes=\"(min-width: 0px) and (max-width: 480px) 480px, (min-width: 481px) 512px, 100vw\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Let&#8217;s look at each component of Kubernetes and determine how to make it scale. The CTO of PerfectScale shares how to optimize k8s deployed applications.<\/p>\n","protected":false},"author":1,"featured_media":1840,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"off","_et_pb_old_content":"","_et_gb_content_width":"","cybocfi_hide_featured_image":"yes","footnotes":""},"categories":[8],"tags":[55,185,300,25,40,14,263,299],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Scale Kubernetes and Boost Performance - Software Engineering Today - The SMC Journal<\/title>\n<meta name=\"description\" content=\"Let&#039;s look at each component of Kubernetes and determine how to make it scale. The CTO of PerfectScale shares how to optimize k8s deployed applications.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Learn How To Scale Kubernetes\" \/>\n<meta property=\"og:description\" content=\"Let&#039;s look at each component of Kubernetes and determine how to make it scale. The CTO of PerfectScale shares how to optimize k8s deployed applications.\" \/>\n<meta property=\"og:url\" content=\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/\" \/>\n<meta property=\"og:site_name\" content=\"Software Engineering Today - The SMC Journal\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ScottMooreConsultingLLC\" \/>\n<meta property=\"article:published_time\" content=\"2023-09-26T10:30:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-09T15:04:26+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/09\/SMC-Journal-Episode-142b.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"scott\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"Learn How To Scale Kubernetes\" \/>\n<meta name=\"twitter:description\" content=\"Let&#039;s look at each component of Kubernetes and determine how to make it scale. The CTO of PerfectScale shares how to optimize k8s deployed applications.\" \/>\n<meta name=\"twitter:image\" content=\"http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/09\/SMC-Journal-Episode-142b.png\" \/>\n<meta name=\"twitter:creator\" content=\"@loadtester\" \/>\n<meta name=\"twitter:site\" content=\"@loadtester\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"scott\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#article\",\"isPartOf\":{\"@id\":\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/\"},\"author\":{\"name\":\"scott\",\"@id\":\"http:\/\/192.168.1.40\/#\/schema\/person\/5a91c9e4dee4875272cb4e91c7bb7605\"},\"headline\":\"Scale Kubernetes and Boost Performance\",\"datePublished\":\"2023-09-26T10:30:00+00:00\",\"dateModified\":\"2024-04-09T15:04:26+00:00\",\"mainEntityOfPage\":{\"@id\":\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/\"},\"wordCount\":530,\"publisher\":{\"@id\":\"http:\/\/192.168.1.40\/#organization\"},\"image\":{\"@id\":\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/09\/SMC-Journal-Episode-142b.png\",\"keywords\":[\"AI\",\"cloud\",\"k8s\",\"kubernetes\",\"loadtest\",\"performance\",\"scalability\",\"scale\"],\"articleSection\":[\"Episode\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/\",\"url\":\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/\",\"name\":\"Scale Kubernetes and Boost Performance - Software Engineering Today - The SMC Journal\",\"isPartOf\":{\"@id\":\"http:\/\/192.168.1.40\/#website\"},\"primaryImageOfPage\":{\"@id\":\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#primaryimage\"},\"image\":{\"@id\":\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/09\/SMC-Journal-Episode-142b.png\",\"datePublished\":\"2023-09-26T10:30:00+00:00\",\"dateModified\":\"2024-04-09T15:04:26+00:00\",\"description\":\"Let's look at each component of Kubernetes and determine how to make it scale. The CTO of PerfectScale shares how to optimize k8s deployed applications.\",\"breadcrumb\":{\"@id\":\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"http:\/\/192.168.1.40\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Scale Kubernetes and Boost Performance\"}]},{\"@type\":\"WebSite\",\"@id\":\"http:\/\/192.168.1.40\/#website\",\"url\":\"http:\/\/192.168.1.40\/\",\"name\":\"Software Engineering Today - The SMC Journal\",\"description\":\"Software Engineering, Performance, Observability, Security, AI, and more\",\"publisher\":{\"@id\":\"http:\/\/192.168.1.40\/#organization\"},\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"http:\/\/192.168.1.40\/#organization\",\"name\":\"Software Engineering With Scott Moore - SMC Journal\",\"alternateName\":\"SMCJournal\",\"url\":\"http:\/\/192.168.1.40\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http:\/\/192.168.1.40\/#\/schema\/logo\/image\/\",\"url\":\"http:\/\/192.168.1.40\/wp-content\/uploads\/2024\/04\/SMC-Journal-1200-x-630.png\",\"contentUrl\":\"http:\/\/192.168.1.40\/wp-content\/uploads\/2024\/04\/SMC-Journal-1200-x-630.png\",\"width\":1200,\"height\":630,\"caption\":\"Software Engineering With Scott Moore - SMC Journal\"},\"image\":{\"@id\":\"http:\/\/192.168.1.40\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/ScottMooreConsultingLLC\",\"https:\/\/x.com\/loadtester\",\"https:\/\/www.linkedin.com\/company\/scott-moore-consulting-llc\"]},{\"@type\":\"Person\",\"@id\":\"http:\/\/192.168.1.40\/#\/schema\/person\/5a91c9e4dee4875272cb4e91c7bb7605\",\"name\":\"scott\",\"sameAs\":[\"http:\/\/192.168.1.40\",\"https:\/\/x.com\/loadtester\"],\"url\":\"http:\/\/192.168.1.40\/author\/scott\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Scale Kubernetes and Boost Performance - Software Engineering Today - The SMC Journal","description":"Let's look at each component of Kubernetes and determine how to make it scale. The CTO of PerfectScale shares how to optimize k8s deployed applications.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/","og_locale":"en_US","og_type":"article","og_title":"Learn How To Scale Kubernetes","og_description":"Let's look at each component of Kubernetes and determine how to make it scale. The CTO of PerfectScale shares how to optimize k8s deployed applications.","og_url":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/","og_site_name":"Software Engineering Today - The SMC Journal","article_publisher":"https:\/\/www.facebook.com\/ScottMooreConsultingLLC","article_published_time":"2023-09-26T10:30:00+00:00","article_modified_time":"2024-04-09T15:04:26+00:00","og_image":[{"width":1280,"height":720,"url":"http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/09\/SMC-Journal-Episode-142b.png","type":"image\/png"}],"author":"scott","twitter_card":"summary_large_image","twitter_title":"Learn How To Scale Kubernetes","twitter_description":"Let's look at each component of Kubernetes and determine how to make it scale. The CTO of PerfectScale shares how to optimize k8s deployed applications.","twitter_image":"http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/09\/SMC-Journal-Episode-142b.png","twitter_creator":"@loadtester","twitter_site":"@loadtester","twitter_misc":{"Written by":"scott","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#article","isPartOf":{"@id":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/"},"author":{"name":"scott","@id":"http:\/\/192.168.1.40\/#\/schema\/person\/5a91c9e4dee4875272cb4e91c7bb7605"},"headline":"Scale Kubernetes and Boost Performance","datePublished":"2023-09-26T10:30:00+00:00","dateModified":"2024-04-09T15:04:26+00:00","mainEntityOfPage":{"@id":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/"},"wordCount":530,"publisher":{"@id":"http:\/\/192.168.1.40\/#organization"},"image":{"@id":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#primaryimage"},"thumbnailUrl":"http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/09\/SMC-Journal-Episode-142b.png","keywords":["AI","cloud","k8s","kubernetes","loadtest","performance","scalability","scale"],"articleSection":["Episode"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/","url":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/","name":"Scale Kubernetes and Boost Performance - Software Engineering Today - The SMC Journal","isPartOf":{"@id":"http:\/\/192.168.1.40\/#website"},"primaryImageOfPage":{"@id":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#primaryimage"},"image":{"@id":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#primaryimage"},"thumbnailUrl":"http:\/\/192.168.1.40\/wp-content\/uploads\/2023\/09\/SMC-Journal-Episode-142b.png","datePublished":"2023-09-26T10:30:00+00:00","dateModified":"2024-04-09T15:04:26+00:00","description":"Let's look at each component of Kubernetes and determine how to make it scale. The CTO of PerfectScale shares how to optimize k8s deployed applications.","breadcrumb":{"@id":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/"]}]},{"@type":"BreadcrumbList","@id":"http:\/\/192.168.1.40\/episode\/learn-how-to-scale-kubernetes\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"http:\/\/192.168.1.40\/"},{"@type":"ListItem","position":2,"name":"Scale Kubernetes and Boost Performance"}]},{"@type":"WebSite","@id":"http:\/\/192.168.1.40\/#website","url":"http:\/\/192.168.1.40\/","name":"Software Engineering Today - The SMC Journal","description":"Software Engineering, Performance, Observability, Security, AI, and more","publisher":{"@id":"http:\/\/192.168.1.40\/#organization"},"inLanguage":"en-US"},{"@type":"Organization","@id":"http:\/\/192.168.1.40\/#organization","name":"Software Engineering With Scott Moore - SMC Journal","alternateName":"SMCJournal","url":"http:\/\/192.168.1.40\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/192.168.1.40\/#\/schema\/logo\/image\/","url":"http:\/\/192.168.1.40\/wp-content\/uploads\/2024\/04\/SMC-Journal-1200-x-630.png","contentUrl":"http:\/\/192.168.1.40\/wp-content\/uploads\/2024\/04\/SMC-Journal-1200-x-630.png","width":1200,"height":630,"caption":"Software Engineering With Scott Moore - SMC Journal"},"image":{"@id":"http:\/\/192.168.1.40\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/ScottMooreConsultingLLC","https:\/\/x.com\/loadtester","https:\/\/www.linkedin.com\/company\/scott-moore-consulting-llc"]},{"@type":"Person","@id":"http:\/\/192.168.1.40\/#\/schema\/person\/5a91c9e4dee4875272cb4e91c7bb7605","name":"scott","sameAs":["http:\/\/192.168.1.40","https:\/\/x.com\/loadtester"],"url":"http:\/\/192.168.1.40\/author\/scott\/"}]}},"_links":{"self":[{"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/posts\/1659"}],"collection":[{"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/comments?post=1659"}],"version-history":[{"count":4,"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/posts\/1659\/revisions"}],"predecessor-version":[{"id":1841,"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/posts\/1659\/revisions\/1841"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/media\/1840"}],"wp:attachment":[{"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/media?parent=1659"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/categories?post=1659"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/192.168.1.40\/wp-json\/wp\/v2\/tags?post=1659"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}