{"id":11167,"date":"2026-11-20T06:44:31","date_gmt":"2026-11-20T06:44:31","guid":{"rendered":"https:\/\/www.hostinger.com\/blog\/?p=11167"},"modified":"2026-11-20T07:15:52","modified_gmt":"2026-11-20T07:15:52","slug":"wordpress-ai-builder-glowup","status":"publish","type":"post","link":"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/","title":{"rendered":"How we found the right models for every task in our AI website builder for WordPress"},"content":{"rendered":"<p class=\"wp-block-paragraph\">The best-scoring AI model isn&rsquo;t always the one you should ship. When we benchmarked the AI behind our AI website builder for WordPress, a smaller, faster model outperformed the top scorer in page design.&nbsp;<\/p><p class=\"wp-block-paragraph\">We ended up with quality improving across every endpoint we upgraded, yet costs decreased. Getting to this point started with a problem. In early September, we replaced the builder&rsquo;s template-based engine with a pipeline that generates every website from scratch.&nbsp;<\/p><p class=\"wp-block-paragraph\">In A\/B testing, customers preferred the new output, but it was significantly more expensive to run. The dozens of LLM tasks behind each site also still relied on a few models chosen when the product was first built.<\/p><p class=\"wp-block-paragraph\">But there was no reliable way to tell whether switching models would actually help.<\/p><p class=\"wp-block-paragraph\">&ldquo;We could change a model and eyeball a few results, but there was no proven way to know it would be okay,&rdquo; says <a data-click-id=\"hgr-post-content-link-eylul-guleryuz\" href=\"https:\/\/www.linkedin.com\/in\/eylulguleryuz\/\" target=\"_blank\" rel=\"noopener\">Eyl&uuml;l G&uuml;lery&uuml;z<\/a>, AI Engineer on our WordPress team.<\/p><p class=\"wp-block-paragraph\">She set out to change that by building a way to measure how well each AI task performs, turning model selection into an informed decision.&nbsp;<\/p><p class=\"wp-block-paragraph\">Here&rsquo;s how she did it.<\/p><p class=\"wp-block-paragraph\"><strong><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_75 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<span class=\"ez-toc-title-toggle\"><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a data-click-id=\"hgr-post-content-link-how-each-ai-model-earned-its-spot\" class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#How_each_AI_model_earned_its_spot\">How each AI model earned its spot<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a data-click-id=\"hgr-post-content-link-one-benchmarking-recipe-for-every-endpoint\" class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#One_benchmarking_recipe_for_every_endpoint\">One benchmarking recipe for every endpoint<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a data-click-id=\"hgr-post-content-link-measuring-what-good-looks-like\" class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#Measuring_what_%E2%80%9Cgood%E2%80%9D_looks_like\">Measuring what &ldquo;good&rdquo; looks like<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a data-click-id=\"hgr-post-content-link-scoring-the-output-quality-from-different-ai-models\" class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#Scoring_the_output_quality_from_different_AI_models\">Scoring the output quality from different AI models<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a data-click-id=\"hgr-post-content-link-picking-the-actual-winners\" class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#Picking_the_actual_winners\">Picking the actual winners<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a data-click-id=\"hgr-post-content-link-what-changed-for-us-and-for-our-customers\" class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#What_changed_for_us_and_for_our_customers\">What changed for us and for our customers<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a data-click-id=\"hgr-post-content-link-the-building-blocks-better-and-cheaper-at-the-same-time\" class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#The_building_blocks_better_and_cheaper_at_the_same_time\">The building blocks: better and cheaper at the same time<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a data-click-id=\"hgr-post-content-link-rebuilding-website-generation-stage-by-stage\" class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#Rebuilding_website_generation_stage_by_stage\">Rebuilding website generation, stage by stage<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a data-click-id=\"hgr-post-content-link-what-customers-actually-see\" class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#What_customers_actually_see\">What customers actually see<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a data-click-id=\"hgr-post-content-link-the-problem-that-slipped-past-the-benchmarks\" class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#The_problem_that_slipped_past_the_benchmarks\">The problem that slipped past the benchmarks<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a data-click-id=\"hgr-post-content-link-turning-model-upgrades-into-pull-requests\" class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#Turning_model_upgrades_into_pull_requests\">Turning model upgrades into pull requests<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a data-click-id=\"hgr-post-content-link-the-best-ai-model-depends-on-the-job\" class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/www.hostinger.com\/blog\/wordpress-ai-builder-glowup\/#The_best_AI_model_depends_on_the_job\">The best AI model depends on the job<\/a><\/li><\/ul><\/nav><\/div>\n<\/strong><\/p><h2 class=\"wp-block-heading h-t-title-2\" id=\"h-how-each-ai-model-earned-its-spot\"><span class=\"ez-toc-section\" id=\"How_each_AI_model_earned_its_spot\"><\/span>How each AI model earned its spot<span class=\"ez-toc-section-end\"><\/span><\/h2><p class=\"wp-block-paragraph\">Eyl&uuml;l first created a flow that lets every model go through the same test.<\/p><h3 class=\"wp-block-heading h-t-title-3\"><span class=\"ez-toc-section\" id=\"One_benchmarking_recipe_for_every_endpoint\"><\/span>One benchmarking recipe for every endpoint<span class=\"ez-toc-section-end\"><\/span><\/h3><p class=\"wp-block-paragraph\">She began by shortlisting around 10 to 12 candidate models, ranging from low-cost options to top-tier frontier alternatives.<\/p><p class=\"wp-block-paragraph\">She then put each one through the same six-step benchmarking process, scoring every endpoint and stage on its own:<\/p><ol class=\"wp-block-list\">\n<li><strong>Collect.<\/strong> Build a test set from actual website requests, filtered for WordPress and with duplicates removed.<\/li>\n\n\n\n<li><strong>Freeze.<\/strong> Select 100 cases per endpoint using a fixed random seed, then pin each dataset with a hash so that every model faces the exact same test and results remain comparable.<\/li>\n\n\n\n<li><strong>Run.<\/strong> Test each model independently, without fallbacks, using production timeouts. Each model runs through the same 100 cases three times, producing 300 outputs per endpoint. Testing models individually matters because, inside a fallback chain, a backup can quietly hide the primary model&rsquo;s failures.<\/li>\n\n\n\n<li><strong>Score.<\/strong> Combine deterministic checks, such as whether the output uses the correct format, language, and fields, with an LLM judge that rates output quality on a 1&ndash;5 scale. Report each score with a 95% confidence interval, so small differences aren&rsquo;t mistaken for real gains.<\/li>\n\n\n\n<li><strong>Publish.<\/strong> Send every run to an internal benchmarking dashboard, tagged with its dataset hash. This keeps results comparable across experiments and over time.<\/li>\n\n\n\n<li><strong>Ship.<\/strong> Roll out the winner as the endpoint&rsquo;s main model. Backup models, tested on the same frozen cases and, ideally, from other AI providers, step in if the primary model fails.<\/li>\n<\/ol><div class=\"wp-block-image\">\n<figure data-wp-context='{\"imageId\":\"6b003004ed0ef\"}' data-wp-interactive=\"core\/image\" data-wp-key=\"6b003004ed0ef\" class=\"aligncenter size-large wp-lightbox-container\"><img decoding=\"async\" width=\"1024\" height=\"358\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on--pointerdown=\"actions.preloadImage\" data-wp-on--pointerenter=\"actions.preloadImageWithDelay\" data-wp-on--pointerleave=\"actions.cancelPreload\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/eylul-benchmarking-recipe-per-endpoint-1024x358.png\" alt=\"The six-step benchmarking process for each AI model: collect real requests, freeze 100 test cases, run each model alone three times, score outputs, publish results to an internal dashboard, and ship the winner with tested fallbacks.\" class=\"wp-image-11169\" srcset=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/eylul-benchmarking-recipe-per-endpoint-1024x358.png 1024w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/eylul-benchmarking-recipe-per-endpoint-300x105.png 300w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/eylul-benchmarking-recipe-per-endpoint-766x268.png 766w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/eylul-benchmarking-recipe-per-endpoint-1536x538.png 1536w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/eylul-benchmarking-recipe-per-endpoint-2048x717.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><button class=\"lightbox-trigger\" type=\"button\" aria-haspopup=\"dialog\" data-wp-bind--aria-label=\"state.thisImage.triggerButtonAriaLabel\" data-wp-init=\"callbacks.initTriggerButton\" data-wp-on--click=\"actions.showLightbox\" data-wp-style--right=\"state.thisImage.buttonRight\" data-wp-style--top=\"state.thisImage.buttonTop\">\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewbox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\"><\/path>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n<\/div><p class=\"wp-block-paragraph\">Scoring each piece on its own has one blind spot: it can&rsquo;t show how the pieces work together. For that, Eyl&uuml;l added a final check on complete websites, built end to end and visually reviewed, which we cover in the later section.<\/p><p class=\"wp-block-paragraph\">Eyl&uuml;l applied the recipe across 18 endpoints and website-generation stages, testing about seven models on each one on average. She used real requests and kept testing new models as they became available.<\/p><p class=\"wp-block-paragraph\">The dashboard turns those results into an internal LLM leaderboard, ranking the tested models for each endpoint by quality, cost, and speed.&nbsp;<\/p><p class=\"wp-block-paragraph\">Other teams in the company can also access the dashboard, so they can choose models for their own products based on these benchmarking results.<\/p><h3 class=\"wp-block-heading h-t-title-3\"><span class=\"ez-toc-section\" id=\"Measuring_what_%E2%80%9Cgood%E2%80%9D_looks_like\"><\/span>Measuring what &ldquo;good&rdquo; looks like<span class=\"ez-toc-section-end\"><\/span><\/h3><p class=\"wp-block-paragraph\">Not all AI tasks produce the same kind of output. For some, there&rsquo;s a reliable expected answer that correctness can be checked against. For others, several different outputs can be equally valid, and quality depends on judgment.<\/p><p class=\"wp-block-paragraph\">This distinction determined how Eyl&uuml;l evaluated them. She used two methods, depending on the endpoint. Some outputs needed only one, while others required both.<\/p><p class=\"wp-block-paragraph\">First, <strong>deterministic checks<\/strong> evaluate outputs against predefined rules. They verify whether the result is valid, follows the expected format, and contains all required fields. When correctness can be defined in advance, these checks provide an objective measure.<\/p><p class=\"wp-block-paragraph\">Second, <strong><\/strong>an LLM judge evaluates outputs that require <strong>qualitative judgment<\/strong>. The LLM judge reads the user&rsquo;s request and the generated output, then rates it from 1 to 5 against predefined criteria, such as how faithfully the result follows the brief and how well it fits the brand. There&rsquo;s no single correct answer in these cases, so using the same judge to score every model keeps the comparisons consistent.<\/p><h4 class=\"wp-block-heading h-t-title-4\">Choosing the LLM judge<\/h4><p class=\"wp-block-paragraph\">The judge itself is an AI model, so Eyl&uuml;l had to evaluate it too. A judge that&rsquo;s too small might miss important quality differences, while a larger model could add unnecessary costs.&nbsp;<\/p><p class=\"wp-block-paragraph\">To select the best LLM judge, she started with the default judge in the team&rsquo;s codebase, then experimented with larger models to see whether they could produce more reliable evaluations.<\/p><p class=\"wp-block-paragraph\">The largest model turned out to be more than most endpoints needed. After benchmarking the judges against each other, she switched to a newer, stronger default model at no extra cost.&nbsp;<\/p><p class=\"wp-block-paragraph\">The exception was page design, where judging quality takes something closer to a human&rsquo;s eye. In this aspect, the largest model was the strongest judge available, but Eyl&uuml;l&rsquo;s end-to-end pipeline test showed that it had limits.<\/p><p class=\"wp-block-paragraph\">She also watched for potential bias. A judge from the same model family as the model it&rsquo;s scoring may favor that model&rsquo;s style. When that happened on one endpoint, Eyl&uuml;l kept spot-checking the results against actual outputs.<\/p><h3 class=\"wp-block-heading h-t-title-3\"><span class=\"ez-toc-section\" id=\"Scoring_the_output_quality_from_different_AI_models\"><\/span>Scoring the output quality from different AI models<span class=\"ez-toc-section-end\"><\/span><\/h3><p class=\"wp-block-paragraph\">To see how these evaluation methods work in practice, let&rsquo;s look at three endpoint examples, from outputs with clearly defined answers to those requiring subjective judgment.<\/p><p class=\"wp-block-paragraph\"><strong>1. Deterministic check method: website-type detection<\/strong><\/p><p class=\"wp-block-paragraph\">This endpoint reads the user&rsquo;s request and identifies the type of website they want to build.<\/p><p class=\"wp-block-paragraph\">For example, a request to create an online store should return the corresponding website-type label. Since there&rsquo;s a predefined correct answer, the output can be evaluated objectively.<\/p><p class=\"wp-block-paragraph\">A top-tier model first drafted the expected labels, which Eyl&uuml;l then reviewed manually. Deterministic checks compared the endpoint&rsquo;s output against these approved labels to verify its correctness.<\/p><p class=\"wp-block-paragraph\"><strong>2. Qualitative judgment method: appointment catalogs<\/strong><\/p><p class=\"wp-block-paragraph\">For businesses that accept bookings, this endpoint generates a list of services customers can book.<\/p><p class=\"wp-block-paragraph\">Consider a massage studio. There&rsquo;s no single correct list of services it should offer. One model might suggest Swedish massage and deep tissue massage, while another might include aromatherapy and hot stone treatments. Both combinations could be relevant, depending on the business and its customers.<\/p><p class=\"wp-block-paragraph\">Because multiple answers can be equally valid, predefined expected outputs wouldn&rsquo;t be enough to assess quality. Eyl&uuml;l therefore relied on the LLM judge for scoring while also manually reviewing the generated results.<\/p><p class=\"wp-block-paragraph\"><strong>3. A combination of both methods: color palette generation<\/strong><\/p><p class=\"wp-block-paragraph\">This endpoint generates six color palette options based on a brand description. For example, a brief for a cozy, vintage bakery should produce six palettes, each containing a set of hex codes.<\/p><p class=\"wp-block-paragraph\">Some parts of the output can be checked objectively, while others require interpretation.<\/p><p class=\"wp-block-paragraph\">Deterministic checks verified that the six palettes were distinct, covered a light-to-dark range, and included at least one dark option. But whether those colors actually suited the bakery&rsquo;s brand was a different question.<\/p><p class=\"wp-block-paragraph\">That&rsquo;s where the LLM judge came in. It evaluated how well each palette matched the brand brief, assessing the subjective quality that code alone couldn&rsquo;t capture.<\/p><div class=\"wp-block-image\">\n<figure data-wp-context='{\"imageId\":\"6b003004efa16\"}' data-wp-interactive=\"core\/image\" data-wp-key=\"6b003004efa16\" class=\"aligncenter size-large wp-lightbox-container\"><img decoding=\"async\" width=\"1024\" height=\"683\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on--pointerdown=\"actions.preloadImage\" data-wp-on--pointerenter=\"actions.preloadImageWithDelay\" data-wp-on--pointerleave=\"actions.cancelPreload\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/input-output-examples-combined-1024x683.jpg\" alt=\"Three examples of how AI outputs were scored: website-type detection with a clear expected answer, an appointment catalog for a massage studio with open-ended output, and a bakery color palette that combines both.\" class=\"wp-image-11170\" srcset=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/input-output-examples-combined-1024x683.jpg 1024w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/input-output-examples-combined-768x512.jpg 768w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/input-output-examples-combined-300x200.jpg 300w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/input-output-examples-combined.jpg 1536w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><button class=\"lightbox-trigger\" type=\"button\" aria-haspopup=\"dialog\" data-wp-bind--aria-label=\"state.thisImage.triggerButtonAriaLabel\" data-wp-init=\"callbacks.initTriggerButton\" data-wp-on--click=\"actions.showLightbox\" data-wp-style--right=\"state.thisImage.buttonRight\" data-wp-style--top=\"state.thisImage.buttonTop\">\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewbox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\"><\/path>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n<\/div><h3 class=\"wp-block-heading h-t-title-3\"><span class=\"ez-toc-section\" id=\"Picking_the_actual_winners\"><\/span>Picking the actual winners<span class=\"ez-toc-section-end\"><\/span><\/h3><p class=\"wp-block-paragraph\">A higher benchmark score didn&rsquo;t automatically make a model win. Eyl&uuml;l used four criteria to decide whether a model was worth switching to.<\/p><p class=\"wp-block-paragraph\"><strong>1. Is it clearly better?<\/strong><\/p><p class=\"wp-block-paragraph\">A higher average score wasn&rsquo;t enough. Eyl&uuml;l set a deliberately conservative rule: a new model was considered better only if its 95% confidence interval didn&rsquo;t overlap with the current model&rsquo;s.<\/p><p class=\"wp-block-paragraph\">If the intervals overlapped, she treated the result as a tie, marking it as &ldquo;within noise&rdquo; rather than claiming an improvement.<\/p><p class=\"wp-block-paragraph\"><strong>2. Is it fast and reliable enough?<\/strong><\/p><p class=\"wp-block-paragraph\">The AI website builder operates in real time, so every model was tested under the same time limits it would face in production. Models that scored well but were too slow or failed too often didn&rsquo;t make the cut.<\/p><p class=\"wp-block-paragraph\"><strong>3. Is it worth the cost?<\/strong><\/p><p class=\"wp-block-paragraph\">Any quality improvement had to justify the additional expense. Some top-tier models performed well but were too costly to use.<\/p><p class=\"wp-block-paragraph\">Self-hosted models faced the same scrutiny. One appeared inexpensive at first, but its quoted price didn&rsquo;t account for the GPUs needed to run it. It also frequently timed out during longer generations, making it an impractical choice despite its seemingly low cost.<\/p><p class=\"wp-block-paragraph\"><strong>4. Does it actually look right?<\/strong><\/p><p class=\"wp-block-paragraph\">Finally, Eyl&uuml;l didn&rsquo;t rely on benchmark scores alone. She compared the LLM judge&rsquo;s ratings against the actual outputs and, for full websites, reviewed screenshots against design principles she&rsquo;d learned from a designer on her team, such as consistent spacing on an 8-point grid, readable line lengths, and enough color contrast.<\/p><p class=\"wp-block-paragraph\">After all, a model can score well on paper and still produce a website that doesn&rsquo;t look or feel right.<\/p><h2 class=\"wp-block-heading h-t-title-2\" id=\"h-what-changed-for-us-and-for-our-customers\"><span class=\"ez-toc-section\" id=\"What_changed_for_us_and_for_our_customers\"><\/span>What changed for us and for our customers<span class=\"ez-toc-section-end\"><\/span><\/h2><p class=\"wp-block-paragraph\">With the benchmarking process in place, Eyl&uuml;l began rolling out the winning models. She started with the smaller endpoints that make foundational decisions about each website, then moved on to the main website-generation stages.<\/p><p class=\"wp-block-paragraph\">The results show how much our WordPress team improved quality and speed while reducing costs, and what those improvements mean for our customers.<\/p><h3 class=\"wp-block-heading h-t-title-3\"><span class=\"ez-toc-section\" id=\"The_building_blocks_better_and_cheaper_at_the_same_time\"><\/span>The building blocks: better and cheaper at the same time<span class=\"ez-toc-section-end\"><\/span><\/h3><p class=\"wp-block-paragraph\">Before a website can take shape, the AI website builder needs to make several foundational decisions: what kind of website to create, which colors and fonts to use, and what content to write.<\/p><p class=\"wp-block-paragraph\">Eyl&uuml;l started by benchmarking the models behind these tasks. Every endpoint she switched to improve quality got better, and most also became cheaper to run.<\/p><p class=\"wp-block-paragraph\">Here&rsquo;s how the changes compared:<\/p><figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Endpoint<\/strong><\/td><td><strong>Quality before &rarr; after (1&ndash;5 score range)<\/strong><\/td><\/tr><tr><td>Product descriptions&nbsp;<\/td><td>3.24 &rarr; 3.78<\/td><\/tr><tr><td>Font pairing&nbsp;<\/td><td>3.47 &rarr; 3.92<\/td><\/tr><tr><td>Colors<\/td><td>4.19 &rarr; 4.72<\/td><\/tr><tr><td>Prompt enhancer<\/td><td>3.44 &rarr; 3.93<\/td><\/tr><tr><td>Post and page generation<\/td><td>2.82 &rarr; 3.31<\/td><\/tr><\/tbody><\/table><\/figure><p class=\"wp-block-paragraph\">Post and page generation was the exception: it became more expensive to run, but the quality improvement was large enough that our WordPress team agreed the trade-off was worth it.<\/p><p class=\"wp-block-paragraph\">One other building block isn&rsquo;t included in the table because it&rsquo;s evaluated using accuracy rather than a 1&ndash;5 quality score.<\/p><p class=\"wp-block-paragraph\"><strong>Website-type detection<\/strong> determines what kind of website the builder should create, so its output is either right or wrong. Its accuracy increased from 95.3% to 98.7%. The new model takes roughly twice as long to respond, but still stays comfortably within its time budget.<\/p><p class=\"wp-block-paragraph\">Not every endpoint needed a new model, though. The benchmarks also helped Eyl&uuml;l identify where switching wouldn&rsquo;t bring meaningful improvements.<\/p><p class=\"wp-block-paragraph\">Page suggestions stayed with the existing model because no challenger clearly outperformed it, and it was already among the cheapest and fastest options.<\/p><p class=\"wp-block-paragraph\">Image keywords also stayed as they were. Every tested model scored low, ranging from 2.28 to 2.41, indicating that the prompt, not the model, was the problem.<\/p><p class=\"wp-block-paragraph\">Site structure was a different case. Its quality improved only within noise, so Eyl&uuml;l switched models based on cost and speed instead, without claiming a quality win.<\/p><h3 class=\"wp-block-heading h-t-title-3\"><span class=\"ez-toc-section\" id=\"Rebuilding_website_generation_stage_by_stage\"><\/span>Rebuilding website generation, stage by stage<span class=\"ez-toc-section-end\"><\/span><\/h3><p class=\"wp-block-paragraph\">The building blocks handle the groundwork for website creation. The main AI engine then takes those decisions and turns them into a complete website through four stages:<\/p><ul class=\"wp-block-list\">\n<li><strong>Discovery<\/strong> works out what the business does, who it serves, and what the website needs to achieve.<\/li>\n\n\n\n<li><strong>Planning<\/strong> maps out the website, deciding which pages to include and what goes on each one.<\/li>\n\n\n\n<li><strong>Page<\/strong> <strong>design<\/strong> lays out every web page, section by section, ready for Elementor or Gutenberg.<\/li>\n\n\n\n<li><strong>Catalog generation<\/strong> fills the website with starter content when needed. It comes in three types: product catalogs for online stores, appointment catalogs for bookable services, and blog catalogs with initial posts.<\/li>\n<\/ul><p class=\"wp-block-paragraph\">Eyl&uuml;l benchmarked each stage independently, including all three catalog types, so each task could have its own best-performing model.<\/p><p class=\"wp-block-paragraph\">Here&rsquo;s what changed:<\/p><figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Website creation stage<\/strong><\/td><td><strong>Quality before &rarr; after (1&ndash;5 score range)<\/strong><\/td><\/tr><tr><td>Discovery<\/td><td>3.78 &rarr; 4.60<\/td><\/tr><tr><td>Planning<\/td><td>3.71 &rarr; 3.77<\/td><\/tr><tr><td>Page design<\/td><td>2.99 &rarr; 3.25<\/td><\/tr><tr><td>Product catalog<\/td><td>3.12 &rarr; 3.27<\/td><\/tr><tr><td>Appointment catalog<\/td><td>3.28 &rarr; 3.42<\/td><\/tr><tr><td>Blog catalog<\/td><td>3.13 &rarr; 3.58<\/td><\/tr><\/tbody><\/table><\/figure><p class=\"wp-block-paragraph\">Quality improved at every stage, but the gains came in different forms.<\/p><ul class=\"wp-block-list\">\n<li><strong>Discovery and catalog generation<\/strong> delivered some of the biggest cost savings while improving quality.<\/li>\n\n\n\n<li><strong>Page design<\/strong> became much cheaper and faster. Its p95 response time (the time within which 95% of requests finish) dropped from 37.9 seconds to 12.4 seconds.<\/li>\n\n\n\n<li><strong>Planning<\/strong> saw only marginal improvements in quality and cost, but its p95 response time fell from roughly 98 seconds to 71 seconds.<\/li>\n<\/ul><p class=\"wp-block-paragraph\">Together, these changes made website generation significantly cheaper while improving quality across every stage.<\/p><p class=\"wp-block-paragraph\">The new setup is also more resilient. Each stage has backup models from other providers, tested against the same frozen cases. This reduces reliance on a single provider and makes website generation less exposed to outages.<\/p><h3 class=\"wp-block-heading h-t-title-3\"><span class=\"ez-toc-section\" id=\"What_customers_actually_see\"><\/span>What customers actually see<span class=\"ez-toc-section-end\"><\/span><\/h3><p class=\"wp-block-paragraph\">Here&rsquo;s how those improvements show up in the websites customers get:<\/p><p class=\"wp-block-paragraph\"><strong>1. Better understanding of website requests<\/strong><\/p><p class=\"wp-block-paragraph\">The builder now identifies the right type of website more reliably, giving every subsequent generation stage a better starting point.<\/p><p class=\"wp-block-paragraph\">For example, a request for a business website with services, a gallery, and online booking is now correctly identified as a multi-page business site.<\/p><div class=\"wp-block-image\">\n<figure data-wp-context='{\"imageId\":\"6b0030050b0a5\"}' data-wp-interactive=\"core\/image\" data-wp-key=\"6b0030050b0a5\" class=\"aligncenter size-large wp-lightbox-container\"><img decoding=\"async\" width=\"1024\" height=\"344\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on--pointerdown=\"actions.preloadImage\" data-wp-on--pointerenter=\"actions.preloadImageWithDelay\" data-wp-on--pointerleave=\"actions.cancelPreload\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/website-type-request-illustration-1024x344.png\" alt=\"A user request for a business website with an about page, services, a photo gallery, and online booking is identified as a business site with bookings, which produces a site map with About us, Services, Gallery, and Booking pages.\" class=\"wp-image-11171\" srcset=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/website-type-request-illustration-1024x344.png 1024w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/website-type-request-illustration-765x257.png 765w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/website-type-request-illustration-300x101.png 300w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/website-type-request-illustration-1536x516.png 1536w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/website-type-request-illustration-2048x688.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><button class=\"lightbox-trigger\" type=\"button\" aria-haspopup=\"dialog\" data-wp-bind--aria-label=\"state.thisImage.triggerButtonAriaLabel\" data-wp-init=\"callbacks.initTriggerButton\" data-wp-on--click=\"actions.showLightbox\" data-wp-style--right=\"state.thisImage.buttonRight\" data-wp-style--top=\"state.thisImage.buttonTop\">\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewbox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\"><\/path>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n<\/div><p class=\"wp-block-paragraph\"><strong>2. More variety in color options<\/strong><\/p><p class=\"wp-block-paragraph\">The builder now generates options that span a wider range, from light to dark. Around 99% of palette sets also include a dark option, giving customers more distinct directions to choose from.<\/p><div class=\"wp-block-image\">\n<figure data-wp-context='{\"imageId\":\"6b0030050d15f\"}' data-wp-interactive=\"core\/image\" data-wp-key=\"6b0030050d15f\" class=\"aligncenter size-large wp-lightbox-container\"><img decoding=\"async\" width=\"1024\" height=\"442\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on--pointerdown=\"actions.preloadImage\" data-wp-on--pointerenter=\"actions.preloadImageWithDelay\" data-wp-on--pointerleave=\"actions.cancelPreload\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/color-palettes-improvement-1024x442.png\" alt=\"Six distinct color palettes generated for one neighborhood bakery brief, ranging from light cream and sage options to dark espresso and near-black designs.\" class=\"wp-image-11172\" srcset=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/color-palettes-improvement-1024x442.png 1024w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/color-palettes-improvement-300x130.png 300w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/color-palettes-improvement-766x331.png 766w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/color-palettes-improvement-1536x664.png 1536w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/color-palettes-improvement-2048x885.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><button class=\"lightbox-trigger\" type=\"button\" aria-haspopup=\"dialog\" data-wp-bind--aria-label=\"state.thisImage.triggerButtonAriaLabel\" data-wp-init=\"callbacks.initTriggerButton\" data-wp-on--click=\"actions.showLightbox\" data-wp-style--right=\"state.thisImage.buttonRight\" data-wp-style--top=\"state.thisImage.buttonTop\">\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewbox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\"><\/path>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n<\/div><p class=\"wp-block-paragraph\"><strong>3. Better handling of multilingual requests<\/strong><\/p><p class=\"wp-block-paragraph\">Generated content now follows the language of the user&rsquo;s request while sticking to the information provided.<\/p><p class=\"wp-block-paragraph\">For example, when asked in Spanish to write a product description for a water bottle, the builder now responds in Spanish without inventing product features.<\/p><div class=\"wp-block-image\">\n<figure data-wp-context='{\"imageId\":\"6b0030050f918\"}' data-wp-interactive=\"core\/image\" data-wp-key=\"6b0030050f918\" class=\"aligncenter size-large wp-lightbox-container\"><img decoding=\"async\" width=\"1024\" height=\"451\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on--pointerdown=\"actions.preloadImage\" data-wp-on--pointerenter=\"actions.preloadImageWithDelay\" data-wp-on--pointerleave=\"actions.cancelPreload\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/multilingual-website-creation-improvement-1024x451.png\" alt=\"A Spanish product name, &ldquo;Termo de agua 1000ml,&rdquo; becomes a product card with a Spanish description that uses only the facts the user provided.\" class=\"wp-image-11173\" srcset=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/multilingual-website-creation-improvement-1024x451.png 1024w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/multilingual-website-creation-improvement-767x338.png 767w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/multilingual-website-creation-improvement-300x132.png 300w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/multilingual-website-creation-improvement-1536x677.png 1536w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/multilingual-website-creation-improvement-2048x903.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><button class=\"lightbox-trigger\" type=\"button\" aria-haspopup=\"dialog\" data-wp-bind--aria-label=\"state.thisImage.triggerButtonAriaLabel\" data-wp-init=\"callbacks.initTriggerButton\" data-wp-on--click=\"actions.showLightbox\" data-wp-style--right=\"state.thisImage.buttonRight\" data-wp-style--top=\"state.thisImage.buttonTop\">\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewbox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\"><\/path>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n<\/div><p class=\"wp-block-paragraph\"><strong>4. Font suggestions that fit the brand<\/strong><\/p><p class=\"wp-block-paragraph\">Font recommendations now better reflect the business&rsquo;s personality.<\/p><p class=\"wp-block-paragraph\">A bakery gets a warm, traditional type, while a software tool gets a clean, modern one, rather than the same generic typefaces for every business.<\/p><div class=\"wp-block-image\">\n<figure data-wp-context='{\"imageId\":\"6b00300511cdf\"}' data-wp-interactive=\"core\/image\" data-wp-key=\"6b00300511cdf\" class=\"aligncenter size-large wp-lightbox-container\"><img decoding=\"async\" width=\"1024\" height=\"458\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on--pointerdown=\"actions.preloadImage\" data-wp-on--pointerenter=\"actions.preloadImageWithDelay\" data-wp-on--pointerleave=\"actions.cancelPreload\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/font-selection-improvement-1024x458.png\" alt=\"Three fictional businesses with fonts that match their personality: a warm, traditional serif for a bakery, a clean, modern sans-serif for a software tool, and a bold, retro display font for a record shop.\" class=\"wp-image-11174\" srcset=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/font-selection-improvement-1024x458.png 1024w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/font-selection-improvement-300x134.png 300w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/font-selection-improvement-766x343.png 766w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/font-selection-improvement-1536x687.png 1536w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/font-selection-improvement-2048x916.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><button class=\"lightbox-trigger\" type=\"button\" aria-haspopup=\"dialog\" data-wp-bind--aria-label=\"state.thisImage.triggerButtonAriaLabel\" data-wp-init=\"callbacks.initTriggerButton\" data-wp-on--click=\"actions.showLightbox\" data-wp-style--right=\"state.thisImage.buttonRight\" data-wp-style--top=\"state.thisImage.buttonTop\">\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewbox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\"><\/path>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n<\/div><h2 class=\"wp-block-heading h-t-title-2\" id=\"h-the-problem-that-slipped-past-the-benchmarks\"><span class=\"ez-toc-section\" id=\"The_problem_that_slipped_past_the_benchmarks\"><\/span>The problem that slipped past the benchmarks<span class=\"ez-toc-section-end\"><\/span><\/h2><p class=\"wp-block-paragraph\">Benchmarking individual stages of website generation helped Eyl&uuml;l identify the best-performing model for each task. But when she tested running the complete pipeline end to end, she discovered that the website output <strong>actually looked worse<\/strong>.<\/p><p class=\"wp-block-paragraph\">The page design winner had scored highest in its isolated benchmark, but in Eyl&uuml;l&rsquo;s judgment, its pages felt raw and the layout looked unbalanced. Meanwhile, a model ranked sixth produced designs much closer to what was shipped before.<\/p><p class=\"wp-block-paragraph\">This is because the LLM judge could assess whether a page included the right sections and followed the brief, but it couldn&rsquo;t tell whether the page actually looked good.<\/p><p class=\"wp-block-paragraph\">The model that ended up shipping in the AI website builder was a smaller, faster one, released while this work was underway. It scored well on the benchmark and held up visually.<\/p><div class=\"wp-block-image\">\n<figure data-wp-context='{\"imageId\":\"6b003005206a7\"}' data-wp-interactive=\"core\/image\" data-wp-key=\"6b003005206a7\" class=\"aligncenter size-large wp-lightbox-container\"><img decoding=\"async\" width=\"1024\" height=\"535\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on--pointerdown=\"actions.preloadImage\" data-wp-on--pointerenter=\"actions.preloadImageWithDelay\" data-wp-on--pointerleave=\"actions.cancelPreload\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/before-after-side-by-side-comparison-1024x535.png\" alt=\"Two website wireframes side by side: the top benchmark scorer&rsquo;s page looks cramped and unbalanced, while the shipped model&rsquo;s page has a balanced layout with clear sections.\" class=\"wp-image-11175\" srcset=\"https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/before-after-side-by-side-comparison-1024x535.png 1024w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/before-after-side-by-side-comparison-300x157.png 300w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/before-after-side-by-side-comparison-1536x802.png 1536w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/before-after-side-by-side-comparison-766x400.png 766w, https:\/\/www.hostinger.com\/blog\/wp-content\/uploads\/sites\/4\/2026\/11\/before-after-side-by-side-comparison-2048x1069.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><button class=\"lightbox-trigger\" type=\"button\" aria-haspopup=\"dialog\" data-wp-bind--aria-label=\"state.thisImage.triggerButtonAriaLabel\" data-wp-init=\"callbacks.initTriggerButton\" data-wp-on--click=\"actions.showLightbox\" data-wp-style--right=\"state.thisImage.buttonRight\" data-wp-style--top=\"state.thisImage.buttonTop\">\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewbox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\"><\/path>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n<\/div><p class=\"wp-block-paragraph\">To confirm the new setup held up, Eyl&uuml;l tested both the old and new setups using the same website requests across seven languages, with both Elementor and Gutenberg, in a real hosting environment. She then compared screenshots of the generated pages side by side. The results showed that:<\/p><ul class=\"wp-block-list\">\n<li><strong>Pages looked more eye-pleasing:<\/strong> The new setup produced more proportional hero sections, photo cards, and clearer headlines.<\/li>\n\n\n\n<li><strong>Costs went down:<\/strong> The new setup was cheaper to run across most of the tested websites.<\/li>\n\n\n\n<li><strong>Generation speed remained comparable:<\/strong> The old setup took an average of 106 seconds, compared with 99 seconds for the new one.<\/li>\n\n\n\n<li><strong>Website generation remained reliable:<\/strong> Both setups applied successfully, with no missing images or sections.<\/li>\n<\/ul><p class=\"wp-block-paragraph\">The live experiment revealed a limitation of isolated benchmarks: the model with the highest score doesn&rsquo;t necessarily produce the best result when it&rsquo;s part of a larger system.<\/p><p class=\"wp-block-paragraph\">That&rsquo;s why Eyl&uuml;l also reviews the actual websites, not just the scores. She acknowledges that this visual judgment is still subjective.&nbsp;<\/p><p class=\"wp-block-paragraph\">&ldquo;I can only judge what looks best to me, so I leaned on the design principles our designer taught me while we built the engine,&rdquo; she says. &ldquo;The next step is turning more of those rules into automatic checks.&rdquo;<\/p><h2 class=\"wp-block-heading h-t-title-2\" id=\"h-turning-model-upgrades-into-pull-requests\"><span class=\"ez-toc-section\" id=\"Turning_model_upgrades_into_pull_requests\"><\/span>Turning model upgrades into pull requests<span class=\"ez-toc-section-end\"><\/span><\/h2><p class=\"wp-block-paragraph\">Testing the next model now takes a pull request and a benchmark run, not a sprint. Eyl&uuml;l set up two feedback loops to make that possible:<\/p><ul class=\"wp-block-list\">\n<li><strong>On every pull request, in minutes.<\/strong> When an engineer touches an endpoint, an automated eval runs the current model and the challenger side by side. A comment on the pull request reports quality, speed, cost, errors, and format checks, and each endpoint gets a pass\/fail status that can block a merge.<\/li>\n\n\n\n<li><strong>The full benchmark.<\/strong> For the final decision, the challenger runs on the same 100 frozen test cases as every earlier model, three times, and the results appear on the dashboard alongside all past runs.<\/li>\n<\/ul><p class=\"wp-block-paragraph\">In one real example, the pull request check came back in under a minute. The challenger scored higher on quality (3.87 &rarr; 4.03), responded faster, and cost noticeably less per request.<\/p><p class=\"wp-block-paragraph\">When a new model is released, validating it takes four steps:<\/p><ol class=\"wp-block-list\">\n<li>Swap the primary model in the endpoint&rsquo;s route and open a pull request.<\/li>\n\n\n\n<li>Read the automated comparison on the pull request.<\/li>\n\n\n\n<li>Run the full benchmark on the frozen dataset.<\/li>\n\n\n\n<li>Merge only if it wins.<\/li>\n<\/ol><p class=\"wp-block-paragraph\">That&rsquo;s how a newly released model reached our planning stage within days. Adding a brand-new endpoint to this system needs just a small spec file and a set of test scenarios.<\/p><h2 class=\"wp-block-heading h-t-title-2\" id=\"h-the-best-ai-model-depends-on-the-job\"><span class=\"ez-toc-section\" id=\"The_best_AI_model_depends_on_the_job\"><\/span>The best AI model depends on the job<span class=\"ez-toc-section-end\"><\/span><\/h2><p class=\"wp-block-paragraph\">Teams building AI-powered products all face the same question: with new models arriving every few weeks, how do they know which one is right for each task? Swapping a model and checking a few outputs only goes so far.<\/p><p class=\"wp-block-paragraph\">Eyl&uuml;l built a repeatable evaluation process based on user requests, frozen test sets, and consistent criteria for comparing models.<\/p><p class=\"wp-block-paragraph\">Along the way, the work challenged a few common assumptions:<\/p><ul class=\"wp-block-list\">\n<li><strong>Better results don&rsquo;t always require more expensive models.<\/strong> Some of the biggest quality gains came with lower costs. And in page design, a smaller, faster model produced better-looking websites than the top scorer.<\/li>\n\n\n\n<li><strong>Different tasks need different models.<\/strong> Understanding a request, choosing colors, and laying out pages each reward different strengths, so no single model is the best default for everything.<\/li>\n\n\n\n<li><strong>Measurement beats guesswork, but it still needs a human eye.<\/strong> With a fixed benchmarking process in place, model upgrades stopped being risky one-off projects and became a routine part of the development process. But scores only capture what they&rsquo;re designed to measure. When quality comes down to taste, like how a website looks, a human still needs to review the actual output.<\/li>\n<\/ul><p class=\"wp-block-paragraph\">Our WordPress team now has better models and a system for testing the next ones, keeping our AI website builder adaptable as new models emerge.<\/p><p class=\"wp-block-paragraph\">If you&rsquo;re building with AI, you can apply the same approach. Freeze a test set built from real requests, so every model faces the same exam. Test each model on its own, without fallbacks hiding its failures. And wherever an automated judge can&rsquo;t reliably tell good from bad, look at the output yourself before you ship.<\/p><div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><a data-click-id=\"hgr-post-content-link-hostinger-com-wordpress-hosting\" aria-label=\"Wordpress hosting\" href=\"https:\/\/www.hostinger.com\/wordpress-hosting\"><img decoding=\"async\" width=\"2048\" height=\"600\" src=\"https:\/\/imagedelivery.net\/LqiWLm-3MGbYHtFuUbcBtA\/wp-content\/uploads\/sites\/4\/2024\/08\/New-WP_in-text-banner.png\/public\" alt=\"\" class=\"wp-image-6639\" srcset=\"https:\/\/imagedelivery.net\/LqiWLm-3MGbYHtFuUbcBtA\/wp-content\/uploads\/sites\/4\/2024\/08\/New-WP_in-text-banner.png\/w=2048,fit=scale-down 2048w, https:\/\/imagedelivery.net\/LqiWLm-3MGbYHtFuUbcBtA\/wp-content\/uploads\/sites\/4\/2024\/08\/New-WP_in-text-banner.png\/w=300,fit=scale-down 300w, https:\/\/imagedelivery.net\/LqiWLm-3MGbYHtFuUbcBtA\/wp-content\/uploads\/sites\/4\/2024\/08\/New-WP_in-text-banner.png\/w=1024,fit=scale-down 1024w, https:\/\/imagedelivery.net\/LqiWLm-3MGbYHtFuUbcBtA\/wp-content\/uploads\/sites\/4\/2024\/08\/New-WP_in-text-banner.png\/w=768,fit=scale-down 768w, https:\/\/imagedelivery.net\/LqiWLm-3MGbYHtFuUbcBtA\/wp-content\/uploads\/sites\/4\/2024\/08\/New-WP_in-text-banner.png\/w=1536,fit=scale-down 1536w\" sizes=\"(max-width: 2048px) 100vw, 2048px\" \/><\/a><\/figure>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>The best-scoring AI model isn\u2019t always the one you should ship. When we benchmarked the AI behind our AI website builder for WordPress, a smaller, faster model outperformed the to\u2026<\/p>\n","protected":false},"author":257,"featured_media":11168,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_content_updated_date":"","footnotes":""},"categories":[82,2365],"tags":[],"hashtags":[],"class_list":["post-11167","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-engineering","category-wordpress"],"hreflangs":[],"_links":{"self":[{"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/posts\/11167","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/users\/257"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/comments?post=11167"}],"version-history":[{"count":1,"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/posts\/11167\/revisions"}],"predecessor-version":[{"id":11176,"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/posts\/11167\/revisions\/11176"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/media\/11168"}],"wp:attachment":[{"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/media?parent=11167"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/categories?post=11167"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/tags?post=11167"},{"taxonomy":"hashtags","embeddable":true,"href":"https:\/\/www.hostinger.com\/blog\/wp-json\/wp\/v2\/hashtags?post=11167"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}