{"id":1602,"date":"2023-11-06T12:07:05","date_gmt":"2023-11-06T12:07:05","guid":{"rendered":"https:\/\/www.darrenlambert.com\/?p=1602"},"modified":"2023-11-06T12:39:21","modified_gmt":"2023-11-06T12:39:21","slug":"i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps","status":"publish","type":"post","link":"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/","title":{"rendered":"I reduced CD pipeline from 43 minutes to 11 minutes, using parallel steps"},"content":{"rendered":"

I work on a large collection of sites for a university.<\/p>\n

It’s a single codebase, shared onto 9 sites.\u00a0 This is done via Bitbucket Pipelines.<\/p>\n

For years each site has it’s own step in the pipeline CD script to copy the files to the server.\u00a0 These steps were run sequentially, one after the other.<\/p>\n

I’ve just changes these 9 steps to run in parallel.<\/p>\n

Typical times were 43 minutes to deploy, but now it’s 11 minutes.<\/p>\n

This will make a big difference, as when checking results on a site at the end of the list, I had to wait a long time.<\/p>\n","protected":false},"excerpt":{"rendered":"

I work on a large collection of sites for a university. It’s a single codebase, shared onto 9 sites.\u00a0 This is done via Bitbucket Pipelines. For years each site has it’s own step in the pipeline CD script to copy the files to the server.\u00a0 These steps were run sequentially, one after the other. I’ve …<\/p>\n","protected":false},"author":1,"featured_media":1604,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[68],"tags":[],"yoast_head":"\nI reduced CD pipeline from 43 minutes to 11 minutes, using parallel steps - Darren Lambert<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"I reduced CD pipeline from 43 minutes to 11 minutes, using parallel steps - Darren Lambert\" \/>\n<meta property=\"og:description\" content=\"I work on a large collection of sites for a university. It’s a single codebase, shared onto 9 sites.\u00a0 This is done via Bitbucket Pipelines. For years each site has it’s own step in the pipeline CD script to copy the files to the server.\u00a0 These steps were run sequentially, one after the other. I’ve …\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/\" \/>\n<meta property=\"og:site_name\" content=\"Darren Lambert\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-06T12:07:05+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-06T12:39:21+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.darrenlambert.com\/wp-content\/uploads\/2023\/11\/cd-parallel-steps.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"536\" \/>\n\t<meta property=\"og:image:height\" content=\"340\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Darren\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Darren\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/\",\"url\":\"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/\",\"name\":\"I reduced CD pipeline from 43 minutes to 11 minutes, using parallel steps - Darren Lambert\",\"isPartOf\":{\"@id\":\"https:\/\/www.darrenlambert.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.darrenlambert.com\/wp-content\/uploads\/2023\/11\/cd-parallel-steps.jpg\",\"datePublished\":\"2023-11-06T12:07:05+00:00\",\"dateModified\":\"2023-11-06T12:39:21+00:00\",\"author\":{\"@id\":\"https:\/\/www.darrenlambert.com\/#\/schema\/person\/ba3d82eb3f9925e946dae3b57e35bb79\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/#primaryimage\",\"url\":\"https:\/\/www.darrenlambert.com\/wp-content\/uploads\/2023\/11\/cd-parallel-steps.jpg\",\"contentUrl\":\"https:\/\/www.darrenlambert.com\/wp-content\/uploads\/2023\/11\/cd-parallel-steps.jpg\",\"width\":536,\"height\":340},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.darrenlambert.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"I reduced CD pipeline from 43 minutes to 11 minutes, using parallel steps\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.darrenlambert.com\/#website\",\"url\":\"https:\/\/www.darrenlambert.com\/\",\"name\":\"Darren Lambert\",\"description\":\"WordPress & WooCommerce Expert\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.darrenlambert.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.darrenlambert.com\/#\/schema\/person\/ba3d82eb3f9925e946dae3b57e35bb79\",\"name\":\"Darren\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.darrenlambert.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/076d975a0d00c5b2d53e2f76076cf5cf?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/076d975a0d00c5b2d53e2f76076cf5cf?s=96&d=mm&r=g\",\"caption\":\"Darren\"},\"url\":\"https:\/\/www.darrenlambert.com\/author\/darren\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"I reduced CD pipeline from 43 minutes to 11 minutes, using parallel steps - Darren Lambert","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/","og_locale":"en_US","og_type":"article","og_title":"I reduced CD pipeline from 43 minutes to 11 minutes, using parallel steps - Darren Lambert","og_description":"I work on a large collection of sites for a university. It’s a single codebase, shared onto 9 sites.\u00a0 This is done via Bitbucket Pipelines. For years each site has it’s own step in the pipeline CD script to copy the files to the server.\u00a0 These steps were run sequentially, one after the other. I’ve …","og_url":"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/","og_site_name":"Darren Lambert","article_published_time":"2023-11-06T12:07:05+00:00","article_modified_time":"2023-11-06T12:39:21+00:00","og_image":[{"width":536,"height":340,"url":"https:\/\/www.darrenlambert.com\/wp-content\/uploads\/2023\/11\/cd-parallel-steps.jpg","type":"image\/jpeg"}],"author":"Darren","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Darren","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/","url":"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/","name":"I reduced CD pipeline from 43 minutes to 11 minutes, using parallel steps - Darren Lambert","isPartOf":{"@id":"https:\/\/www.darrenlambert.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/#primaryimage"},"image":{"@id":"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/#primaryimage"},"thumbnailUrl":"https:\/\/www.darrenlambert.com\/wp-content\/uploads\/2023\/11\/cd-parallel-steps.jpg","datePublished":"2023-11-06T12:07:05+00:00","dateModified":"2023-11-06T12:39:21+00:00","author":{"@id":"https:\/\/www.darrenlambert.com\/#\/schema\/person\/ba3d82eb3f9925e946dae3b57e35bb79"},"breadcrumb":{"@id":"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/#primaryimage","url":"https:\/\/www.darrenlambert.com\/wp-content\/uploads\/2023\/11\/cd-parallel-steps.jpg","contentUrl":"https:\/\/www.darrenlambert.com\/wp-content\/uploads\/2023\/11\/cd-parallel-steps.jpg","width":536,"height":340},{"@type":"BreadcrumbList","@id":"https:\/\/www.darrenlambert.com\/i-reduced-cd-pipeline-from-43-minutes-to-11-minutes-using-parallel-steps\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.darrenlambert.com\/"},{"@type":"ListItem","position":2,"name":"I reduced CD pipeline from 43 minutes to 11 minutes, using parallel steps"}]},{"@type":"WebSite","@id":"https:\/\/www.darrenlambert.com\/#website","url":"https:\/\/www.darrenlambert.com\/","name":"Darren Lambert","description":"WordPress & WooCommerce Expert","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.darrenlambert.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.darrenlambert.com\/#\/schema\/person\/ba3d82eb3f9925e946dae3b57e35bb79","name":"Darren","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.darrenlambert.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/076d975a0d00c5b2d53e2f76076cf5cf?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/076d975a0d00c5b2d53e2f76076cf5cf?s=96&d=mm&r=g","caption":"Darren"},"url":"https:\/\/www.darrenlambert.com\/author\/darren\/"}]}},"jetpack_featured_media_url":"https:\/\/www.darrenlambert.com\/wp-content\/uploads\/2023\/11\/cd-parallel-steps.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/posts\/1602"}],"collection":[{"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/comments?post=1602"}],"version-history":[{"count":1,"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/posts\/1602\/revisions"}],"predecessor-version":[{"id":1603,"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/posts\/1602\/revisions\/1603"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/media\/1604"}],"wp:attachment":[{"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/media?parent=1602"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/categories?post=1602"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.darrenlambert.com\/wp-json\/wp\/v2\/tags?post=1602"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}