mysql查询需要3个小时来运行和处理

Question

我有一个在深夜执行 cron 作业的查询。 然后通过生成器处理此查询，因为它必须填充另一个数据库，并且在将其发送到另一个数据库之前我会进行一些额外的处理和检查。

我想知道无论如何我是否可以加快此查询并希望将其保留为单个查询。 还是我会被迫创建其他查询并在 PHP 中加入数据？ 这会查询主 mautic 数据库。

SELECT  c.id as "campaign_id",
        c.created_by_user,
        c.name,
        c.date_added,
        c.date_modified,
        (SELECT DISTINCT COUNT(cl.lead_id)) as number_of_leads,
        GROUP_CONCAT(lt.tag) as tags,
        cat.title as category_name,
        GROUP_CONCAT(ll.name) as segment_name,
        GROUP_CONCAT(emails.name) as email_name,
        CASE WHEN c.is_published = 1 THEN "Yes" ELSE "No" END AS "published",
        CASE WHEN c.publish_down > now() THEN "Yes" 
             WHEN c.publish_down > now() AND c.is_published = 0 THEN "Yes" 
             ELSE "No" END AS "expired"
FROM campaigns c 
    LEFT JOIN campaign_leads cl ON cl.campaign_id = c.id
    LEFT JOIN lead_tags_xref ltx on cl.lead_id = ltx.lead_id 
    LEFT JOIN lead_tags lt on ltx.tag_id = lt.id 
    LEFT JOIN categories cat on c.category_id = cat.id 
    LEFT JOIN lead_lists_leads llist on cl.lead_id = llist.lead_id 
    LEFT JOIN lead_lists ll on llist.leadlist_id = ll.id 
    LEFT JOIN email_list_xref el on ll.id = el.leadlist_id 
    LEFT JOIN emails on el.email_id = emails.id 
GROUP BY c.id;

这是解释https://prnt.sc/qQtUaLK3FIpQ的图像

定义活动表： https ://prnt.sc/6JXRGyMsWpcd

Campaign_leads 表https://prnt.sc/pOq0_SxW2spe

Lead_tags_xref 表https://prnt.sc/oKYn92O82gHL

铅标签表https://prnt.sc/ImH81ECF6Ly1

类别表https://prnt.sc/azQj_Xwq3dw9

Lead_lists_lead 表https://prnt.sc/x5C5fiBFP2N7

Lead_lists 表https://prnt.sc/bltkM0f3XeaH

email_list_xref 表https://prnt.sc/kXABVJSYWEUI

电子邮件表https://prnt.sc/7fZcBir1a6QT

我只希望完成 871 行，我已经确定连接可能非常大，数以万计。

Answer 1

似乎您有一个无用的选择 DISTINTC .. 您是否正在寻找一个 conut(distinct .. )
通过这种方式，您可以避免主选择中每一行的嵌套选择..

SELECT  c.id as "campaign_id",
        c.created_by_user,
        c.name,
        c.date_added,
        c.date_modified,
        COUNT(DISTINCT cl.lead_id) as number_of_leads,
        GROUP_CONCAT(lt.tag) as tags,
        cat.title as category_name,
        GROUP_CONCAT(ll.name) as segment_name,
        GROUP_CONCAT(emails.name) as email_name,
        CASE WHEN c.is_published = 1 THEN "Yes" ELSE "No" END AS "published",
        CASE WHEN c.publish_down > now() THEN "Yes" 
             WHEN c.publish_down > now() AND c.is_published = 0 THEN "Yes" 
             ELSE "No" END AS "expired"
FROM campaigns c 
    LEFT JOIN campaign_leads cl ON cl.campaign_id = c.id
    LEFT JOIN lead_tags_xref ltx on cl.lead_id = ltx.lead_id 
    LEFT JOIN lead_tags lt on ltx.tag_id = lt.id 
    LEFT JOIN categories cat on c.category_id = cat.id 
    LEFT JOIN lead_lists_leads llist on cl.lead_id = llist.lead_id 
    LEFT JOIN lead_lists ll on llist.leadlist_id = ll.id 
    LEFT JOIN email_list_xref el on ll.id = el.leadlist_id 
    LEFT JOIN emails on el.email_id = emails.id 
GROUP BY c.id;

无论如何要确保你有一个适当的复合索引

table campaign_leads columns campaign_id, lead_id
table lead_tags_xref columns lead_id, tag_id
table lead_lists_leads columns lead_id, leadlist_id
table email_list_xref columns leadlist_id, email_id