CSE455 Project 3 Web Page

Albert Chiu

 

 

Query results

Below, you’ll find the results of some of the queries that were ran.  It should be noted that some images were much easier to differentiate and got much better results.  In particular, the beach was easily confused with many other images, while the cherry images were easy to isolate from the rest of the images.

 

 

Query Image: beach_1 using OPP, INT and without spatial information

 

Image Name

INT value

Image

beach_1.ppm

1

boat_3.ppm

0.592376

crater_4.ppm

0.584303

sunset2_2.ppm

0.540827

boat_4.ppm

0.538685

sunset2_4.ppm

0.535094

boat_5.ppm

0.534619

beach_2.ppm

0.508685

beach_4.ppm

0.503984

sunset2_3.ppm

0.499648

beach_3.ppm

0.496693

crater_3.ppm

0.489326

pond_3.ppm

0.488281

crater_5.ppm

0.476247

crater_2.ppm

0.465918

beach_5.ppm

0.46054

pond_1.ppm

0.454049

stHelens_3.ppm

0.453779

boat_2.ppm

0.441351

pond_5.ppm

0.424492

pond_2.ppm

0.413431

stHelens_4.ppm

0.402552

crater_1.ppm

0.386406

pond_4.ppm

0.38028

stHelens_2.ppm

0.365479

boat_1.ppm

0.358158

sunset1_5.ppm

0.346833

sunset2_1.ppm

0.339049

stHelens_5.ppm

0.329092

sunset2_5.ppm

0.328382

sunset1_1.ppm

0.262188

stHelens_1.ppm

0.257454

sunset1_3.ppm

0.245016

sunset1_2.ppm

0.238337

sunset1_4.ppm

0.23377

cherry_2.ppm

0.172036

cherry_1.ppm

0.161624

cherry_5.ppm

0.161182

cherry_3.ppm

0.138781

cherry_4.ppm

0.131768

 

 

 

Query Image: beach_1 using OPP, INT and with spatial information

 

Image Name

INT value

Image

beach_1.ppm

1

crater_4.ppm

0.492996

beach_5.ppm

0.459601

sunset2_4.ppm

0.445974

boat_3.ppm

0.443688

boat_5.ppm

0.385315

sunset2_2.ppm

0.375532

stHelens_3.ppm

0.370562

crater_3.ppm

0.369208

sunset2_3.ppm

0.355654

beach_2.ppm

0.351594

crater_2.ppm

0.351404

boat_2.ppm

0.338192

beach_4.ppm

0.331823

crater_5.ppm

0.328395

beach_3.ppm

0.328137

crater_1.ppm

0.323684

stHelens_5.ppm

0.315705

sunset1_5.ppm

0.315681

stHelens_2.ppm

0.314481

pond_3.ppm

0.295947

stHelens_4.ppm

0.28689

pond_1.ppm

0.271593

boat_4.ppm

0.268499

stHelens_1.ppm

0.244772

sunset2_1.ppm

0.22922

boat_1.ppm

0.227753

pond_2.ppm

0.224409

sunset1_4.ppm

0.198391

sunset2_5.ppm

0.179832

pond_4.ppm

0.175285

pond_5.ppm

0.146132

sunset1_1.ppm

0.145884

cherry_5.ppm

0.138044

sunset1_3.ppm

0.134319

sunset1_2.ppm

0.121784

cherry_1.ppm

0.118927

cherry_2.ppm

0.118434

cherry_4.ppm

0.10585

cherry_3.ppm

0.095056

 

Query Image: boat_5 using OPP, INT and without spatial information

boat_5.ppm

1

boat_3.ppm

0.874772

boat_4.ppm

0.757601

boat_2.ppm

0.665599

beach_1.ppm

0.534619

beach_2.ppm

0.513818

crater_4.ppm

0.503346

sunset2_4.ppm

0.479095

crater_5.ppm

0.463669

beach_3.ppm

0.449714

stHelens_5.ppm

0.442767

beach_5.ppm

0.409687

beach_4.ppm

0.405143

sunset1_5.ppm

0.378327

crater_3.ppm

0.369277

sunset2_5.ppm

0.363105

stHelens_1.ppm

0.337008

stHelens_2.ppm

0.330882

pond_5.ppm

0.326247

crater_1.ppm

0.312438

cherry_5.ppm

0.307593

sunset1_3.ppm

0.306436

sunset1_4.ppm

0.304935

crater_2.ppm

0.304551

stHelens_3.ppm

0.300853

sunset1_2.ppm

0.295169

sunset1_1.ppm

0.26651

stHelens_4.ppm

0.258324

pond_2.ppm

0.254801

cherry_2.ppm

0.25441

pond_1.ppm

0.254063

cherry_1.ppm

0.247306

sunset2_2.ppm

0.243229

pond_3.ppm

0.23848

boat_1.ppm

0.238236

cherry_3.ppm

0.228154

sunset2_3.ppm

0.210505

pond_4.ppm

0.200111

cherry_4.ppm

0.185777

sunset2_1.ppm

0.173512

 

 

Query Image: boat_5 using OPP, INT and with spatial information

 

boat_5.ppm

1

boat_3.ppm

0.861403

boat_4.ppm

0.70767

boat_2.ppm

0.593927

crater_4.ppm

0.445756

crater_5.ppm

0.404868

sunset2_4.ppm

0.402807

beach_1.ppm

0.385315

stHelens_5.ppm

0.348731

beach_2.ppm

0.348595

sunset1_5.ppm

0.305905

beach_5.ppm

0.298574

sunset2_5.ppm

0.29197

beach_3.ppm

0.281918

cherry_5.ppm

0.273438

stHelens_1.ppm

0.270554

sunset1_3.ppm

0.269529

sunset1_4.ppm

0.26688

crater_2.ppm

0.262861

sunset1_2.ppm

0.261032

crater_3.ppm

0.250965

stHelens_2.ppm

0.245842

beach_4.ppm

0.234087

crater_1.ppm

0.232914

sunset1_1.ppm

0.215765

stHelens_3.ppm

0.208944

pond_3.ppm

0.200907

stHelens_4.ppm

0.198519

cherry_1.ppm

0.182959

pond_1.ppm

0.182165

pond_2.ppm

0.181182

cherry_2.ppm

0.179547

boat_1.ppm

0.175282

pond_5.ppm

0.171389

sunset2_2.ppm

0.152677

cherry_3.ppm

0.138226

pond_4.ppm

0.131957

sunset2_3.ppm

0.13109

sunset2_1.ppm

0.101841

cherry_4.ppm

0.090593

 

Query Image: cherry_3 using OPP, INT and without spatial information

 

Image Name

INT value

Image

cherry_3.ppm

1

cherry_4.ppm

0.855881

cherry_1.ppm

0.8536

cherry_2.ppm

0.843191

cherry_5.ppm

0.574825

stHelens_1.ppm

0.321933

sunset2_5.ppm

0.288117

beach_3.ppm

0.275774

pond_5.ppm

0.275529

boat_2.ppm

0.270535

sunset1_4.ppm

0.269298

sunset1_5.ppm

0.265008

stHelens_2.ppm

0.259437

beach_2.ppm

0.258999

stHelens_4.ppm

0.256469

boat_3.ppm

0.249657

stHelens_3.ppm

0.246455

pond_1.ppm

0.244341

pond_4.ppm

0.243557

sunset1_3.ppm

0.24218

crater_3.ppm

0.234039

beach_4.ppm

0.233692

pond_2.ppm

0.228837

boat_5.ppm

0.228154

sunset2_4.ppm

0.22362

sunset1_1.ppm

0.22354

pond_3.ppm

0.222784

crater_5.ppm

0.220163

sunset1_2.ppm

0.215494

boat_1.ppm

0.210543

crater_4.ppm

0.208112

stHelens_5.ppm

0.206779

boat_4.ppm

0.181484

beach_1.ppm

0.138781

crater_2.ppm

0.126446

crater_1.ppm

0.110273

beach_5.ppm

0.101606

sunset2_3.ppm

0.094367

sunset2_2.ppm

0.086631

sunset2_1.ppm

0.052223

 

Query Image: cherry_3 using OPP, INT and with spatial information

 

cherry_3.ppm

1

cherry_4.ppm

0.83762

cherry_1.ppm

0.770254

cherry_2.ppm

0.692093

cherry_5.ppm

0.565107

stHelens_1.ppm

0.256337

stHelens_4.ppm

0.223979

stHelens_2.ppm

0.221232

sunset1_4.ppm

0.214352

stHelens_3.ppm

0.20629

sunset2_5.ppm

0.205646

crater_3.ppm

0.202493

sunset1_5.ppm

0.20004

beach_3.ppm

0.1995

boat_1.ppm

0.188443

crater_5.ppm

0.1831

beach_4.ppm

0.176552

boat_2.ppm

0.176112

sunset1_2.ppm

0.175573

sunset1_3.ppm

0.172879

crater_4.ppm

0.166602

stHelens_5.ppm

0.162797

sunset1_1.ppm

0.160449

pond_5.ppm

0.155736

pond_3.ppm

0.14698

boat_4.ppm

0.143996

boat_5.ppm

0.138226

pond_1.ppm

0.137531

boat_3.ppm

0.135682

pond_2.ppm

0.134049

beach_2.ppm

0.126908

sunset2_4.ppm

0.121862

beach_1.ppm

0.095056

beach_5.ppm

0.089651

crater_2.ppm

0.079343

crater_1.ppm

0.071587

pond_4.ppm

0.069644

sunset2_3.ppm

0.06482

sunset2_2.ppm

0.045956

sunset2_1.ppm

0.028677

 

Query Image: stHelens_2 using OPP, INT and without spatial information

stHelens_2.ppm

1

stHelens_3.ppm

0.870706

stHelens_4.ppm

0.81474

stHelens_1.ppm

0.644349

boat_1.ppm

0.620195

stHelens_5.ppm

0.552113

beach_3.ppm

0.517305

crater_5.ppm

0.458542

beach_4.ppm

0.45209

crater_4.ppm

0.446068

crater_1.ppm

0.424033

crater_3.ppm

0.409847

boat_3.ppm

0.40749

boat_4.ppm

0.39917

boat_2.ppm

0.398115

beach_2.ppm

0.380091

pond_3.ppm

0.375081

beach_5.ppm

0.373997

beach_1.ppm

0.365479

pond_5.ppm

0.353887

pond_2.ppm

0.331908

cherry_5.ppm

0.331465

boat_5.ppm

0.330882

crater_2.ppm

0.325078

pond_1.ppm

0.321982

sunset2_5.ppm

0.316768

sunset2_3.ppm

0.309297

pond_4.ppm

0.301276

sunset2_2.ppm

0.299756

cherry_2.ppm

0.29701

cherry_1.ppm

0.292885

sunset2_4.ppm

0.279027

sunset1_3.ppm

0.266966

sunset1_2.ppm

0.259606

cherry_3.ppm

0.259437

sunset1_1.ppm

0.258343

cherry_4.ppm

0.254932

sunset1_5.ppm

0.214225

sunset1_4.ppm

0.194876

sunset2_1.ppm

0.170853

 

Query Image: stHelens_2 using OPP, INT and with spatial information

 

Image Name

INT value

Image

stHelens_2.ppm

1

stHelens_3.ppm

0.839864

stHelens_4.ppm

0.775326

stHelens_1.ppm

0.607905

boat_1.ppm

0.573573

stHelens_5.ppm

0.529528

beach_3.ppm

0.508033

beach_4.ppm

0.432654

crater_1.ppm

0.386678

beach_2.ppm

0.343451

beach_1.ppm

0.314481

boat_3.ppm

0.30966

beach_5.ppm

0.305045

cherry_5.ppm

0.297491

cherry_1.ppm

0.263256

boat_2.ppm

0.259586

crater_3.ppm

0.257701

pond_3.ppm

0.254691

crater_4.ppm

0.252407

pond_1.ppm

0.249467

cherry_2.ppm

0.248803

boat_5.ppm

0.245842

crater_5.ppm

0.236946

boat_4.ppm

0.234895

pond_2.ppm

0.232899

cherry_3.ppm

0.221232

sunset2_5.ppm

0.206453

sunset1_3.ppm

0.1997

cherry_4.ppm

0.195956

sunset1_1.ppm

0.195244

sunset1_2.ppm

0.190672

pond_5.ppm

0.187108

sunset1_4.ppm

0.173474

crater_2.ppm

0.161724

sunset1_5.ppm

0.143312

sunset2_4.ppm

0.127597

sunset2_3.ppm

0.116367

pond_4.ppm

0.108311

sunset2_2.ppm

0.094658

sunset2_1.ppm

0.079052

 

 

Query Image: sunset1_2 using OPP, INT and without spatial information

Image Name

INT Value

Image

sunset1_2.ppm

1

sunset1_3.ppm

0.919782

sunset1_1.ppm

0.845514

sunset2_5.ppm

0.561488

sunset2_4.ppm

0.548262

sunset1_5.ppm

0.48347

boat_2.ppm

0.435957

sunset1_4.ppm

0.435072

crater_4.ppm

0.351087

crater_5.ppm

0.350954

pond_4.ppm

0.321302

crater_1.ppm

0.314023

boat_4.ppm

0.306637

beach_5.ppm

0.295407

boat_5.ppm

0.295169

crater_3.ppm

0.28778

sunset2_1.ppm

0.286803

sunset2_2.ppm

0.286523

boat_3.ppm

0.281999

sunset2_3.ppm

0.260788

stHelens_2.ppm

0.259606

crater_2.ppm

0.25861

stHelens_3.ppm

0.257546

stHelens_1.ppm

0.244727

cherry_5.ppm

0.241275

cherry_2.ppm

0.241085

boat_1.ppm

0.239775

beach_1.ppm

0.238337

stHelens_5.ppm

0.23792

beach_3.ppm

0.23041

cherry_1.ppm

0.224755

stHelens_4.ppm

0.216647

cherry_3.ppm

0.215494

pond_5.ppm

0.210498

cherry_4.ppm

0.203724

pond_2.ppm

0.202389

beach_2.ppm

0.200524

beach_4.ppm

0.176335

pond_1.ppm

0.144333

pond_3.ppm

0.124889

 

 

Query Image: sunset1_2 using OPP, INT and without spatial information

sunset1_2.ppm

1

sunset1_3.ppm

0.913177

sunset1_1.ppm

0.844175

sunset2_4.ppm

0.463559

boat_2.ppm

0.409793

sunset2_5.ppm

0.400095

sunset1_4.ppm

0.39797

sunset1_5.ppm

0.372454

crater_5.ppm

0.279084

boat_5.ppm

0.261032

boat_3.ppm

0.257461

boat_4.ppm

0.257252

crater_4.ppm

0.237475

sunset2_2.ppm

0.2189

cherry_5.ppm

0.212509

sunset2_3.ppm

0.207508

cherry_2.ppm

0.20284

cherry_1.ppm

0.194092

stHelens_1.ppm

0.192264

stHelens_2.ppm

0.190672

beach_3.ppm

0.188798

crater_2.ppm

0.187715

beach_2.ppm

0.178801

crater_3.ppm

0.177638

cherry_3.ppm

0.175573

stHelens_3.ppm

0.172501

beach_4.ppm

0.162732

sunset2_1.ppm

0.157954

beach_5.ppm

0.153346

crater_1.ppm

0.153073

stHelens_4.ppm

0.146854

stHelens_5.ppm

0.142865

cherry_4.ppm

0.124137

beach_1.ppm

0.121784

boat_1.ppm

0.116331

pond_4.ppm

0.103095

pond_5.ppm

0.083018

pond_2.ppm

0.082645

pond_1.ppm

0.065988

pond_3.ppm

0.062474

 

 

This is the original order for google images in the search for beach.

 

 

Here is the new order after querying them with the beach_1 image using OPP, INT, and spacial information

 

NOTE: the number in the image name corresponds to the rank it had in google i.e. b1.jpg.ppm was the first image.  Images were converted into ppm format so they could be processed.

 

Image name

INT value

Image

b9.jpg.ppm

0.556096

b20.jpg.ppm

0.398279

b1.jpg.ppm

0.380431

b13.jpg.ppm

0.275357

b17.jpg.ppm

0.242072

b19.jpg.ppm

0.241527

b11.jpg.ppm

0.208648

b2.jpg.ppm

0.203051

b12.jpg.ppm

0.18091

b8.jpg.ppm

0.18071

b4.jpg.ppm

0.151391

b18.jpg.ppm

0.114777

b14.jpg.ppm

0.107319

b15.jpg.ppm

0.097433

b16.jpg.ppm

0.086829

b3.jpg.ppm

0.082236

b7.jpg.ppm

0.070856

b10.jpg.ppm

0.06295

b6.jpg.ppm

0.031681

b5.jpg.ppm

0.030695

 

 

Which method is best?

 

To find out which method is best, we judge the methods based on their recall and their precision.  Below is a graph with the average recall and average precision of each method for each image.  From this graph, it is difficult to ascertain a clear favorite.

 

 

To try to get a better picture, below we graph the average precision value at a given recall for all the methods.  Here, we get a slighter clearer graph, and while there is significant overlap, it seems that using OPP and INT gives an edge to graph accuracy.  Above all else, the use of INT instead of SSD for differentiating images makes the greatest impact on the quality of the query.

 

 

Google Searches

Here is the original google order for querying boat.

 

 

Here is the rearranged boat images after querying them with the boat_2 image, using OPP, INT, and spacial information.

 

NOTE: image name corresponds to the rank in which the image appeared in google.  i.e. a1.jpg.ppm was the first image in the google search.  Files were converted into ppm format so they could be processed.

 

Image names

INT value

Image

a9.jpg.ppm

0.533394

a17.jpg.ppm

0.450841

a5.jpg.ppm

0.426519

a1.jpg.ppm

0.380844

a3.jpg.ppm

0.345147

a18.jpg.ppm

0.331477

a6.jpg.ppm

0.319145

a16.jpg.ppm

0.291987

a13.jpg.ppm

0.280886

a8.jpg.ppm

0.250419

a7.jpg.ppm

0.227756

a11.jpg.ppm

0.221169

a15.jpg.ppm

0.203309

a20.jpg.ppm

0.175492

a12.jpg.ppm

0.171891

a14.jpg.ppm

0.14096

a2.jpg.ppm

0.12175

a10.jpg.ppm

0.120847

a19.jpg.ppm

0.085112

a4.jpg.ppm

0.069755