This topic describes the Correlation Coefficient Matrix component provided by Machine Learning Designer (formerly known as Machine Learning Studio).

A correlation coefficient indicates the correlation between columns in a matrix. The coefficient is in the range of [-1,1]. The count parameter is measured when the value is the number of non-zero elements in two consecutive columns.

Configure the component

You can use one of the following methods to configure the Correlation Coefficient Matrix component.

You can configure the parameters of the Correlation Coefficient Matrix component on the pipeline page of Machine Learning Designer of Machine Learning Platform for AI (PAI). Machine Learning Designer is formerly known as Machine Learning Studio. The following table describes the parameters.
TabParameterDescription
Fields SettingAll Selected by DefaultN/A.
TuningCoresThis parameter must be used with the Memory Size parameter.
Memory SizeThis parameter must be used with the Cores parameter.

Method 2: Use PAI commands

Configure the component parameters by using PAI commands. You can use the SQL Script component to call PAI commands. For more information, see SQL Script.
PAI -name corrcoef
    -project algo_public
    -DinputTableName=maple_test_corrcoef_basic12x10_input
    -DoutputTableName=maple_test_corrcoef_basic12x10_output
    -DcoreNum=1
    -DmemSizePerCore=110;
ParameterRequiredDescriptionDefault value
inputTableNameYesThe name of the input table. No default value
inputTablePartitionsNoThe partitions that are selected from the input table for training. The following formats are supported:
  • Partition_name=value
  • name1=value1/name2=value2: multi-level partitions
Note If you specify multiple partitions, separate them with commas (,).
No default value
outputTableNameYesThe name of the output table. No default value
selectedColNamesNoThe columns selected from the input table. All columns
lifecycleNoThe lifecycle of the output table. No default value
coreNumNoThis parameter must be used with the memSizePerCore parameter. The value must be a positive integer. Valid values: 1 to 9999. Determined by the system
memSizePerCoreNoThe memory size of each core. Unit: MB. The value must be a positive integer in the range of [1024, 64 × 1024]. Determined by the system

Example

  • Input data
    col0:doublecol1:bigintcol2:doublecol3:bigintcol4:doublecol5:bigintcol6:doublecol7:bigintcol8:doublecol9:double
    199533521154332987640
    1142610169565911623109105
    10389796511873505581
    7920637152477312175
    871666472514429910857
    111043837106513918097
    843070468694224548
    3517107641011253349096
    13613912911711228228
    624102881003667541285
    492744936811060728658
    9211901134115748318111
  • PAI command
    PAI -name corrcoef
        -project algo_public
        -DinputTableName=maple_test_corrcoef_basic12x10_input
        -DoutputTableName=maple_test_corrcoef_basic12x10_output
        -DcoreNum=1
        -DmemSizePerCore=110;
  • Output
    columnsnamescol0col1col2col3col4col5col6col7col8col9
    col01-0.21156572518207240.05983062597065610.2599903570684693-0.3483249188225586-0.287162543968099260.47880162127435116-0.13646519484213326-0.195001587646800920.3897390240949085
    col1-0.21156572518207241-0.8444477377898585-0.175076362215945330.409433841505713770.09135976026101403-0.30185063746265740.40733726912808044-0.118277391245900710.12433851389455183
    col20.0598306259706561-0.844447737789858510.18518346647293102-0.20934839228057014-0.18964175123896590.1799377498863213-0.38588856764699480.202545692037738920.13476160753756655
    col30.2599903570684693-0.175076362215945330.1851834664729310210.03988018649854009-0.43737887418329147-0.0538182964252671840.2900856441586986-0.36075479100756880.4912019074930449
    col4-0.34832491882255860.40943384150571377-0.209348392280570140.0398801864985400910.1465605209246875-0.50160303643479550.54960243257111170.0137432561153941220.07497231559184887
    col5-0.287162543968099260.09135976026101403-0.1896417512389659-0.437378874183291470.146560520924687510.16729809310873522-0.298906558287969640.3618518101014617-0.1713960957286885
    col60.47880162127435116-0.30185063746265740.1799377498863213-0.053818296425267184-0.50160303643479550.167298093108735221-0.8165019880156462-0.11173420918721436-0.10363860378347944
    col7-0.136465194842133260.40733726912808044-0.38588856764699480.29008564415869860.5496024325711117-0.29890655828796964-0.816501988015646210.074359074715444690.11711976051999162
    col8-0.19500158764680092-0.118277391245900710.20254569203773892-0.36075479100756880.0137432561153941220.3618518101014617-0.111734209187214360.074359074715444691-0.18463012549540175
    col90.38973902409490850.124338513894551830.134761607537566550.49120190749304490.07497231559184887-0.1713960957286885-0.103638603783479440.11711976051999162-0.184630125495401751