By Farzad H Eskafi feskafisparc It com Sparc

By: Farzad H. Eskafi feskafi@sparc. It. com

Sparc. It Overview Key Accomplishments Summary – Large-scale automated creativity assessment • Open-ended Exercises • Semantic-based Psychometric Model • Machine Learning, Data Mining, Comp Linguistics • • – Funded by National Science Foundation – San Francisco, CA Farzad H. Eskafi Co-founder, CEO – Over 30, 000 assessments – Benchmark 161 different countries 16 industries 12 departments 11 positions & roles Kenes Beketayev, Ph. D Co-founder, CTO Machine Learning Confidential

How to Measure Creativity? Creativity Quotient (CQ) (Semantic based Psychometric Approach) Fluency # of unique & relevant responses – – – Originality Elaboration Measure of statistical infrequency of responses Measure of details per each idea Flexibility # of distinct categories represented 50+ years of academic research 30+ years of operational research Measuring abilities (not personalities) No survey type questions Game-like open-ended exercises to measure and enhance Confidential

What do participants see? • Open-ended Exercises • 2 -page report Confidential

Research Summary • Overview – N = 15, 000+ users – 30, 000+ assessments were administered – 30+ studies • Internal Reliability • Concurrent Validity • Test-Retest • Assessments: – 300+ verified item – Minimum of 5 items (can be 3 items) – At least 3 min per each item • Partnership with: – – – SUNY Buffalo University of Georgia at Athens Princeton University Stanford University Private Pilots Confidential

Internal Reliability Across Studies Buffalo. S 15 (n=7, 434) Int. Study 14 (n=7, 228) Originality Flexibility Fluency Elaboration 0. 73 0. 84 0. 70 0. 79 0. 82 0. 71 Exercise Originality Flexibility Fluency Elaboration Loop. It Map. It Tie. It Resque. It Odd. It 0. 76 0. 73 0. 86 0. 81 0. 75 0. 70 0. 78 ---- 0. 79 0. 80 ---- 0. 82 0. 76 0. 87 -0. 80 Confidential 0. 89 0. 81 Coefficient of Internal Consistency: Analysis must be done per index per exercise. • • • α ≥ 0. 9 : Excellent (High-Stakes testing) 0. 7 ≤ α < 0. 9: Good (Low-Stakes testing) 0. 6 ≤ α < 0. 7: Acceptable 0. 5 ≤ α < 0. 6: Poor α < 0. 5: Unacceptable Average result is above 0. 7 which is ideal for assessment tests.

Concurrent Validity, Test-Retest Concurrent Validity n = 351 r. CAB Fluency r. CAB Flexibility r. CAB Originality Fluency 0. 98 --- -0. 74 -- --0. 36 Flexibility Originality Time 0. 13 0. 12 0. 06 0. 51 0. 46 0. 07 GPA Test-Retest Buffalo. S 15 GPA Mood Originality Flexibility Fluency • • Treatment (n=7, 434) 0. 34 0. 31 0. 42 Control (n=353) 0. 72 0. 83 0. 90 Confidential Time 0. 10 0. 08 0. 13 GPA < 3. 0 correlates to low score GPA > 3. 0 has insignificant correlation. • Time < 187 sec correlates to low score • Time > 187 sec has insignificant correlation

Internal Reliability Across Studies Originality Flexibility Fluency Elaboration Buffalo. S 15 (n=7, 434) 0. 73 0. 84 Int. Study 14 (n=7, 228) 0. 70 0. 79 0. 82 0. 71 Exercise Originality Flexibility Fluency Elaboration Loop. It Map. It Tie. It Resque. It Odd. It 0. 76 0. 73 0. 86 0. 81 0. 75 0. 70 0. 78 ---- 0. 79 0. 80 ---- 0. 82 0. 76 0. 87 -0. 80 Confidential 0. 89 0. 81 Coefficient of Internal Consistency: Analysis must be done per index per exercise. • • • α ≥ 0. 9 : Excellent (High-Stakes testing) 0. 7 ≤ α < 0. 9: Good (Low-Stakes testing) 0. 6 ≤ α < 0. 7: Acceptable 0. 5 ≤ α < 0. 6: Poor α < 0. 5: Unacceptable Average result is above 0. 7 which is ideal for assessment tests.

Test-Retest Correlation Buffalo. S 15 Originality Flexibility Fluency Treatment (n=7, 434) 0. 34 0. 31 0. 42 Control (n=353) 0. 72 0. 83 0. 90 Test-Retest Analysis: Conduct the same set of assessment within a short time period: • Range is (-1, 1). • +1 if perfect direct increasing relationship • -1 if perfect inverse decreasing relationship • 0 if independent Given the same condition, the correlation would be high. Confidential

Concurrent Validity n = 351 Fluency Flexibility Originality r. CAB Fluency r. CAB Flexibility 0. 98 --- -0. 74 -- Comparison of Sparc. It’s engine against external factors • • • r. CAB Originality Range is (-1, 1). +1 if perfect direct increasing relationship -1 if perfect inverse decreasing relationship 0 if independent Note: Coefficient of 0. 35 is considered a strong correlation. GPA Mood -- 0. 13 -- 0. 12 0. 36 0. 06 GPA • • Time Confidential 0. 10 0. 08 0. 13 Time 0. 51 0. 46 0. 07 GPA < 3. 0 correlates to low score GPA > 3. 0 has insignificant correlation. • Time < 187 sec correlates to low score • Time > 187 sec has insignificant correlation

Questions? Confidential