Content-Based Image Retrieval using Color Histograms

Zijian Gu

CSE 455 Computer Vision

Winter 2009

Project 3 Artifact

  • Query Results
  • Retrieval Performance
  • Google Image Results
  • Query Results
    Query Results for beach_1 with C = OPP, S = INT, and SP = YES
     
                     
    beach_1
        crater_2     crater_3       boat_5         sunset1_3     boat_3       sunset2_5     pond_4       sunset1_4     pond_5
    INT = 1   INT = 0.61   INT = 0.57 INT = 0.52   INT = 0.49 INT = 0.42 INT = 0.37 INT = 0.36 INT = 0.35 INT = 0.35
         
               
    cherry_3      pond_3      pond_1         cherry_1    beach_5       crater_4     sunset2_4     sunset2_2     crater_5     sunset2_3
    INT = 0.35 INT = 0.35 INT = 0.35 INT = 0.35 INT = 0.32 INT = 0.28 INT = 0.25 INT = 0.18 INT = 0.18 INT = 0.17
                     
    crater_1     sunset1_1     beach_2     sunset1_2     stHelens_5   beach_4     beach_3       stHelens_4 stHelens_1 stHelens_2
    INT = 0.15 INT = 0.15 INT = 0.15 INT = 0.14   INT = 0.1     INT = 0.1 INT = 0.09 INT = 0.07 INT = 0.07 INT = 0.05
                                     
    stHelens_3   boat_2       sunset1_5     boat_1       boat_4         sunset2_1         cherry_4           cherry_5           cherry_2     pond_2
    INT = 0.04 INT = 0.03 INT = 0.02 INT = 0.005 INT = 0.004 INT = 0.0006 INT = 0.0001 INT = 6.8e-5 INT = 6.8e-5 INT = 3.6e-5

    Query Results for beach_1 with C = OPP, S = INT, and SP = NO
     
                     
    beach_1
        crater_2     sunset1_3       crater_3      boat_5     sunset2_5       sunset1_4     boat_3       pond_4     pond_5
    INT = 1   INT = 0.62   INT = 0.62 INT = 0.57   INT = 0.52 INT = 0.51 INT = 0.43 INT = 0.42 INT = 0.35 INT = 0.35
         
               
    pond
    _3      pond_1      sunset2_4         cherry_3    cherry_1       crater_4     beach_5     sunset1_2     sunset1_1     sunset2_2
    INT = 0.35 INT = 0.35 INT = 0.35 INT = 0.35 INT = 0.35 INT = 0.32 INT = 0.32 INT = 0.28 INT = 0.28 INT = 0.27
                     
    sunset2_3     crater_5     beach_2     boat_2       crater_1       stHelens_5     beach_4       stHelens_4 beach_3    stHelens_1
    INT = 0.23 INT = 0.22 INT = 0.2 INT = 0.17   INT = 0.16     INT = 0.16 INT = 0.13 INT = 0.13 INT = 0.12 INT = 0.12
                                     
    stHelens_2   stHelens_3   sunset2_1     sunset1_5     boat_1        boat_4         pond_2           cherry_4           cherry_2     cherry_5
    INT = 0.08 INT = 0.08 INT = 0.07 INT = 0.02 INT = 0.005 INT = 0.004 INT = 0.0004 INT = 0.0002 INT = 7.9e-5 INT = 7.2e-5

    Query Results for boat_5 with C = OPP, S = INT, and SP = YES (text only)

    boat_5.ppm 1.00152
    pond_4.ppm 0.833921
    pond_5.ppm 0.833316
    pond_3.ppm 0.833091
    pond_1.ppm 0.833003
    cherry_3.ppm 0.832965
    cherry_1.ppm 0.832912
    boat_3.ppm 0.828901
    sunset1_4.ppm 0.780763
    crater_2.ppm 0.620093
    crater_3.ppm 0.612265
    beach_1.ppm 0.521163
    sunset2_5.ppm 0.520477
    sunset1_3.ppm 0.379836
    crater_4.ppm 0.129838
    beach_2.ppm 0.1212
    sunset2_4.ppm 0.116476
    crater_1.ppm 0.069262
    beach_4.ppm 0.0605624
    crater_5.ppm 0.0554896
    beach_5.ppm 0.0540342
    beach_3.ppm 0.0454942
    sunset2_2.ppm 0.0316041
    sunset1_2.ppm 0.0212538
    boat_2.ppm 0.0193328
    sunset1_1.ppm 0.0166827
    sunset1_5.ppm 0.0096844
    stHelens_5.ppm 0.00822607
    stHelens_2.ppm 0.00753267
    stHelens_3.ppm 0.00750662
    stHelens_4.ppm 0.00730478
    stHelens_1.ppm 0.0055371
    sunset2_3.ppm 0.00449869
    boat_4.ppm 0.000934244
    sunset2_1.ppm 0.000777994
    boat_1.ppm 0.000390625
    pond_2.ppm 9.76562e-005
    cherry_4.ppm 4.38997e-005
    cherry_2.ppm 1.42073e-005
    cherry_5.ppm 3.6507e-006


    Query Results for boat_5 with C = OPP, S = INT, and SP = NO (text only)

    boat_5.ppm 1.00152
    pond_4.ppm 0.833921
    pond_5.ppm 0.833316
    pond_3.ppm 0.833091
    pond_1.ppm 0.833003
    cherry_3.ppm 0.832965
    cherry_1.ppm 0.832912
    boat_3.ppm 0.828901
    sunset1_4.ppm 0.780763
    crater_2.ppm 0.620093
    crater_3.ppm 0.612265
    beach_1.ppm 0.521163
    sunset2_5.ppm 0.520477
    sunset1_3.ppm 0.379836
    crater_4.ppm 0.129838
    beach_2.ppm 0.1212
    sunset2_4.ppm 0.116476
    crater_1.ppm 0.069262
    beach_4.ppm 0.0605624
    crater_5.ppm 0.0554896
    beach_5.ppm 0.0540342
    beach_3.ppm 0.0454942
    sunset2_2.ppm 0.0316041
    sunset1_2.ppm 0.0212538
    boat_2.ppm 0.0193328
    sunset1_1.ppm 0.0166827
    sunset1_5.ppm 0.0096844
    stHelens_5.ppm 0.00822607
    stHelens_2.ppm 0.00753267
    stHelens_3.ppm 0.00750662
    stHelens_4.ppm 0.00730478
    stHelens_1.ppm 0.0055371
    sunset2_3.ppm 0.00449869
    boat_4.ppm 0.000934244
    sunset2_1.ppm 0.000777994
    boat_1.ppm 0.000390625
    pond_2.ppm 9.76562e-005
    cherry_4.ppm 4.38997e-005
    cherry_2.ppm 1.42073e-005
    cherry_5.ppm 3.6507e-006

    Query Results for cherry_3 with C = OPP, S = INT, and SP = YES (text only)

    cherry_3.ppm 1.00552
    cherry_1.ppm 1.00326
    pond_3.ppm 0.998516
    pond_1.ppm 0.998459
    pond_5.ppm 0.994607
    pond_4.ppm 0.948831
    boat_5.ppm 0.831889
    boat_3.ppm 0.823562
    sunset1_4.ppm 0.778005
    crater_3.ppm 0.556656
    crater_2.ppm 0.546311
    sunset2_5.ppm 0.516753
    sunset1_3.ppm 0.366
    beach_1.ppm 0.353338
    cherry_4.ppm 0.00219704
    sunset2_2.ppm 0.0010694
    stHelens_3.ppm 0.000365959
    stHelens_4.ppm 0.000342714
    crater_1.ppm 0.000326438
    beach_3.ppm 0.000325612
    beach_4.ppm 0.000325612
    beach_3.ppm 0.000325612
    beach_4.ppm 0.000325612
    stHelens_2.ppm 0.000319102
    stHelens_5.ppm 0.000319102
    stHelens_2.ppm 0.000319102
    stHelens_5.ppm 0.000319102
    stHelens_1.ppm 0.000311354
    sunset2_4.ppm 0.000210396
    boat_2.ppm 0.000158726
    boat_4.ppm 0.000150977
    boat_1.ppm 0.000102654
    crater_4.ppm 9.44927e-005
    sunset1_5.ppm 8.43603e-005
    sunset2_3.ppm 5.09371e-005
    beach_2.ppm 5.08913e-005
    cherry_2.ppm 4.76819e-005
    beach_5.ppm 4.43809e-005
    crater_5.ppm 3.58531e-005
    cherry_5.ppm 3.30106e-005
    sunset2_1.ppm 1.79266e-005
    pond_2.ppm 6.51042e-006
    sunset1_1.ppm 0
    sunset1_2.ppm 0

    Query Results for cherry_3 with C = OPP, S = INT, and SP = NO (text only)

    cherry_3.ppm 0.996971
    pond_5.ppm 0.994787
    pond_3.ppm 0.994772
    cherry_1.ppm 0.994722
    pond_1.ppm 0.994714
    pond_4.ppm 0.95062
    boat_5.ppm 0.832965
    boat_3.ppm 0.824587
    sunset1_4.ppm 0.778753
    crater_3.ppm 0.555984
    crater_2.ppm 0.545605
    sunset2_5.ppm 0.515876
    sunset1_3.ppm 0.365356
    beach_1.ppm 0.352727
    cherry_4.ppm 0.00218677
    sunset2_2.ppm 0.00110936
    stHelens_4.ppm 0.000404133
    beach_4.ppm 0.000393485
    stHelens_1.ppm 0.000393485
    beach_4.ppm 0.000393485
    stHelens_1.ppm 0.000393485
    beach_3.ppm 0.00038381
    stHelens_2.ppm 0.00037444
    stHelens_3.ppm 0.00036507
    stHelens_5.ppm 0.000357769
    crater_1.ppm 0.000354118
    sunset2_4.ppm 0.000284207
    sunset1_2.ppm 0.000171552
    boat_2.ppm 0.000158623
    boat_4.ppm 0.000150926
    beach_2.ppm 0.000130726
    crater_4.ppm 0.000116914
    boat_1.ppm 0.000102311
    beach_5.ppm 9.3032e-005
    sunset1_5.ppm 8.39661e-005
    crater_5.ppm 5.80157e-005
    sunset1_1.ppm 5.76202e-005
    sunset2_3.ppm 5.07143e-005
    cherry_2.ppm 4.74591e-005
    cherry_5.ppm 3.28563e-005
    sunset2_1.ppm 1.7858e-005
    pond_2.ppm 6.51042e-006

    Query Results for stHelens_2 with C = OPP, S = INT, and SP = YES (text only)

    stHelens_2.ppm 1.00027
    stHelens_3.ppm 0.875839
    cherry_4.ppm 0.497264
    stHelens_4.ppm 0.354953
    stHelens_1.ppm 0.28042
    stHelens_5.ppm 0.257003
    beach_3.ppm 0.217502
    beach_4.ppm 0.200184
    crater_1.ppm 0.134937
    boat_1.ppm 0.130755
    beach_2.ppm 0.123564
    beach_1.ppm 0.052507
    beach_5.ppm 0.0488742
    sunset1_3.ppm 0.0369827
    sunset1_1.ppm 0.0343297
    crater_4.ppm 0.0304106
    crater_2.ppm 0.029906
    sunset1_2.ppm 0.0292583
    crater_3.ppm 0.0286785
    sunset2_3.ppm 0.0280539
    sunset2_2.ppm 0.0278358
    crater_5.ppm 0.0209215
    sunset2_4.ppm 0.0180862
    sunset2_5.ppm 0.00244792
    pond_4.ppm 0.000367839
    sunset1_5.ppm 0.000335286
    boat_3.ppm 0.000325521
    cherry_3.ppm 0.000319102
    boat_5.ppm 0.000263672
    boat_4.ppm 0.000260417
    pond_5.ppm 0.000166016
    boat_2.ppm 0.000117187
    sunset1_4.ppm 6.51042e-005
    pond_3.ppm 5.20833e-005
    sunset2_1.ppm 4.23177e-005
    pond_2.ppm 2.60417e-005
    pond_1.ppm 1.30208e-005
    cherry_1.ppm 0
    cherry_2.ppm 0
    cherry_5.ppm 0

    Query Results for stHelens_2 with C = OPP, S = INT, and SP = NO (text only)

    stHelens_2.ppm 0.999244
    stHelens_3.ppm 0.88426
    cherry_4.ppm 0.496336
    stHelens_4.ppm 0.357675
    stHelens_1.ppm 0.281808
    beach_3.ppm 0.25972
    stHelens_5.ppm 0.257822
    beach_4.ppm 0.209146
    beach_2.ppm 0.200213
    boat_1.ppm 0.181201
    crater_1.ppm 0.164405
    beach_1.ppm 0.0807199
    crater_4.ppm 0.074763
    sunset2_4.ppm 0.0638414
    sunset2_2.ppm 0.0620842
    beach_5.ppm 0.0620809
    sunset2_3.ppm 0.0619182
    crater_2.ppm 0.057276
    sunset1_1.ppm 0.0537638
    crater_5.ppm 0.0533861
    sunset1_3.ppm 0.0528361
    crater_3.ppm 0.0507005
    sunset1_2.ppm 0.0458961
    boat_2.ppm 0.0363481
    sunset2_5.ppm 0.0302089
    sunset2_1.ppm 0.0197562
    boat_3.ppm 0.0192413
    pond_4.ppm 0.0171127
    sunset1_4.ppm 0.0149938
    sunset1_5.ppm 0.0133139
    boat_5.ppm 0.00753267
    boat_4.ppm 0.00398112
    pond_5.ppm 0.00268555
    pond_3.ppm 0.00138346
    pond_1.ppm 0.000989583
    cherry_3.ppm 0.00037444
    pond_2.ppm 0.000322265
    cherry_2.ppm 1.09521e-005
    cherry_1.ppm 0
    cherry_5.ppm 0

    Query Results for
    sunset1_2 with C = OPP, S = INT, and SP = YES (text only)

    sunset1_2.ppm 0.996711
    sunset1_3.ppm 0.565571
    sunset1_1.ppm 0.516674
    crater_5.ppm 0.466083
    stHelens_4.ppm 0.451148
    beach_3.ppm 0.412887
    sunset2_4.ppm 0.23986
    sunset2_2.ppm 0.189295
    sunset2_5.ppm 0.189153
    sunset2_3.ppm 0.162985
    sunset1_4.ppm 0.144937
    boat_2.ppm 0.144712
    beach_1.ppm 0.142439
    beach_5.ppm 0.117772
    crater_4.ppm 0.0800822
    sunset2_1.ppm 0.0765482
    stHelens_5.ppm 0.0520685
    stHelens_1.ppm 0.0497776
    crater_2.ppm 0.0494977
    crater_1.ppm 0.0398166
    stHelens_2.ppm 0.0292583
    crater_3.ppm 0.0274892
    beach_2.ppm 0.0257083
    stHelens_3.ppm 0.0244404
    boat_5.ppm 0.0211933
    sunset1_5.ppm 0.00965188
    beach_4.ppm 0.00736339
    pond_4.ppm 0.00641933
    boat_3.ppm 0.0040886
    pond_3.ppm 0.00111979
    pond_5.ppm 0.00108398
    pond_1.ppm 0.000800781
    boat_4.ppm 0.000598958
    pond_2.ppm 0.000253906
    boat_1.ppm 0.000218099
    cherry_1.ppm 0
    cherry_2.ppm 0
    cherry_3.ppm 0
    cherry_4.ppm 0
    cherry_5.ppm 0

    Query Results for
    sunset1_2 with C = OPP, S = INT, and SP = NO (text only)

    sunset1_2.ppm 0.996022
    sunset1_3.ppm 0.566925
    sunset1_1.ppm 0.518219
    crater_5.ppm 0.494478
    stHelens_4.ppm 0.46551
    beach_3.ppm 0.428705
    sunset2_4.ppm 0.302267
    sunset2_5.ppm 0.289901
    beach_1.ppm 0.280655
    sunset2_2.ppm 0.258557
    beach_5.ppm 0.238075
    sunset2_3.ppm 0.222979
    boat_2.ppm 0.165932
    sunset2_1.ppm 0.16552
    sunset1_4.ppm 0.146083
    crater_2.ppm 0.126613
    stHelens_5.ppm 0.103506
    crater_4.ppm 0.0981938
    crater_3.ppm 0.0859343
    stHelens_1.ppm 0.0587705
    crater_1.ppm 0.0480314
    stHelens_2.ppm 0.0458961
    stHelens_3.ppm 0.0337768
    beach_2.ppm 0.0300236
    pond_4.ppm 0.0214942
    boat_5.ppm 0.0212538
    beach_4.ppm 0.020772
    sunset1_5.ppm 0.0124969
    boat_3.ppm 0.00431315
    pond_5.ppm 0.00238281
    pond_3.ppm 0.00124023
    pond_1.ppm 0.000908203
    boat_4.ppm 0.000791015
    cherry_4.ppm 0.000397439
    pond_2.ppm 0.00038737
    boat_1.ppm 0.000266927
    cherry_3.ppm 0.000171552
    cherry_2.ppm 7.3014e-006
    cherry_1.ppm 0
    cherry_5.ppm 0

    Retrieval Performance
    Here are graphs of the average precision % and average recall % across the 5 query images, for each of the 8 combinations.









    RGB INT YES appears to be the best combination of options for our 5 query image set, since it starts at the highest precision % and starts at almost 50% recall. All the graphs fall to about 20% precision by the 15 image mark, so it's not worse than the other options.
    Google Image Results.
    Top 20 Google images sorted by similarity to beach_1.ppm with C=OPP, S=INT, SP=YES:

    beach-sky.ppm 0.504576

    eratap_beach.ppm 0.353246

    miami-beach.ppm 0.35324

    myspace-beach-pictures-0001.ppm 0.353004

    Sunset-Beach.ppm 0.352852

    SunsetBeach.ppm 0.224872

    big_makena-beach_550.ppm 0.158733

    EastBeach1.ppm 0.138422

    devils-beach.ppm 0.123213

    beach_wallpaper_brazil.ppm 0.07946

    beach.ppm 0.0371411

    1390526-Nice_view_of_the_beach_eh-Daytona_Beach.ppm 0.0175196

    scarborough+beach.ppm 0.0111185

    beach101801.ppm 0.00368695

    poipu_beach_park_001.ppm 0.000254924

    EastBeach2.ppm 0.000171542

    beach7.ppm 0.000114848

    siam-beach-resort-koh-chang.ppm 6.11751e-005

    beach1a.ppm 0

    beach8.ppm 0

    Top 20 Google images sorted by similarity to boat_2.ppm with C=OPP, S=INT, SP=YES:

    boat-main.ppm 0.0945297

    boat2.ppm 0.0425834

    EcoBoatPA1_468x309.jpe.ppm 0.042429

    boat-sub.ppm 0.0382731

    boat-1_7071.ppm 0.0351362

    electric_boat-c39b.ppm 0.0211566

    Sailing_Boat.ppm 0.00146364

    solar-powered-boat1.ppm 0.00120631

    2026_04_39---Speed-boat_web.ppm 0.000665107

    fat-boat-1.ppm 0.000422431

    BOAT1.ppm 0.000372047

    zodiac_boat.ppm 0.000328176

    The_Jolly_Boat.ppm 0.000261418

    SCUBA-the-boat.ppm 0.000218895

    BoatLkPowellm.ppm 0.000218307

    boat-2_7071.ppm 9.48106e-005

    boat_hull.ppm 6.83594e-005

    boat-loans.ppm 6.2724e-005

    boat12.ppm 3.2495e-005