如何优化SQL查询以返回数百万条记录

Question

All the example used below is currently for only one Salesorganization and we may have more different salesOrganization number later in future.

I have 6 tables which has millions of records. This tables are populated by execution of SSIS package.

select count(*) from tmp_materials --11,02,032

select count(*) from tbl_VendorLogoData --20,41,501
select count(*) from TBL_Image_EDV --4,44,063
select count(*) from TBL_EXTPRODUCTATTRIBUTES_EDV  -- 2,06,15,572
select count(*) from TBL_Accessories_EDV --10,11,568
select count(*) from TBL_SimilarSku --64,10,408

I have a stored procedure which is used to select distinct records from these tables

SELECT  DISTINCT    'MD' AS [COMPANYCD]
                    , MAIN.MATERIAL AS [MATERIAL]
                    , ISNULL(UPPER(IMG.[lowprovider]),'')  AS [LOW_IMAGE]
                    , ISNULL(UPPER(IMG.[midprovider]), '') AS [MID_IMAGE]
                    , ISNULL(UPPER(IMG.[highprovider]), '') AS [HIGH_IMAGE]
                    , ISNULL(UPPER(VS.isLogo),'') AS [VENDOR_LOGO]
                    , ISNULL(UPPER(DS.PROVIDER), '') AS [DATASHEET]
                    , ISNULL(ACC.AccessoryMaterial, '') AS [OPT_ACC]
                    , ISNULL(UPPER(ACC.Provider), '') AS [OPT_ACC_PROVIDER]     
                    , ISNULL(SS.Similarsku, '') AS [SIMILAR_SKU]
                    , ISNULL(UPPER(SS.ProviderName), '') AS [SIMILAR_SKU_PROVIDER]
FROM            tmp_materials MAIN WITH (NOLOCK)
LEFT OUTER JOIN TBL_Image_EDV IMG WITH (NOLOCK) ON MAIN.MATERIAL = IMG.MATERIAL AND MAIN.salesOrg = IMG.SalesOrganization
LEFT OUTER JOIN TBL_EXTPRODUCTATTRIBUTES_EDV DS WITH (NOLOCK) ON MAIN.MATERIAL = DS.SKUNBR AND MAIN.salesOrg = DS.SalesOrganization
LEFT OUTER JOIN TBL_Accessories_EDV ACC WITH (NOLOCK) ON MAIN.MATERIAL = ACC.ParentSKU AND MAIN.salesOrg = DS.SalesOrganization
LEFT OUTER JOIN TBL_SimilarSku SS WITH (NOLOCK) ON MAIN.MATERIAL = SS.ParentSKU AND MAIN.salesOrg = DS.SalesOrganization
LEFT OUTER JOIN tbl_VendorLogoData VS WITH (NOLOCK) ON MAIN.MATERIAL = VS.SKU AND MAIN.salesOrg = VS.Salesorganization
WHERE           MAIN.salesOrg = @SALESORGANIZATION
                AND (CASE   WHEN IMG.MATERIAL IS NULL AND DS.SKUNBR IS NULL  AND ACC.ParentSKU IS NULL  AND SS.ParentSKU IS NULL AND VS.SKU IS NULL
                            THEN 0 ELSE 1 END) = 1
                AND DS.Provider <> 'novalue' 
                AND SS.RecordIdentifier like '%@@%'
                AND ACC.RecordIdentifier like '%@@%'
                AND ACC.accessorySku LIKE '%@@%' 

The parameter for these procedure is @SALESORGANIZATION This is used to populate a report. I am running this for multiple salesorganization values. But for one of the salesorganization it is taking more than 5 hours to generate the data.

It seems i will need to write a loop, but finding it difficult to proceed with multiple joins any suggestions?

Please advice how can i optimize this query? Thanks for your assitance.

There you have an execution plan file SQL Execution Plan

Answer 1

Try to include more condition to improve performance.

In all the LEFT OUTER JOIN checks include your parameter directly and try to avoid JOINDE tables using there eg

LEFT OUTER JOIN TBL_Image_EDV IMG WITH (NOLOCK) ON 
MAIN.MATERIAL = IMG.MATERIAL 
AND MAIN.salesOrg = IMG.SalesOrganization 
AND IMG.SalesOrganization=@SALESORGANIZATION

Add conditions in the WHERE

AND SS.RecordIdentifier like '%@@%'

should be

(SS.id IS NOT NULL AND SS.RecordIdentifier like '%@@%')

Thus you first cut the rows with no relation

UPDATE

One more idea

Try

INNER JOIN (select * 
                 from TBL_Accessories_EDV 
                 where RecordIdentifier like '%@@%'
                   AND accessorySku LIKE '%@@%') ACC WITH (NOLOCK) 
 ON MAIN.MATERIAL = ACC.ParentSKU AND MAIN.salesOrg = DS.SalesOrganization

Just to restrict amout of records you filter out later