Skip to content

Aperture photometry benchmarks

Brigitta Sipocz edited this page Jun 3, 2014 · 5 revisions

Benchmarks before and after adding positions as Aperture class member

Benchmarks before changing the API (latest commit is ce841006268bd0d95ec696cfbec9c3c95d05a5c8):

This is the reference, the new aperture photometry should provide at least this speed...

===============================================================================
Small data, single small aperture   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
   0.29342 
   0.29035 
   0.27718 
   0.27693 

-------------------------------------------------------------------------------
Real time:     1.1381 s

===============================================================================
Big data, single small aperture   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
   0.27986 
   0.27906 
   0.28114 
   0.27852 

-------------------------------------------------------------------------------
Real time:     1.1188 s

===============================================================================
Big data, single big aperture   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
   1.15869 
   1.08271 
   1.30651 
   1.08762 

-------------------------------------------------------------------------------
Real time:     0.0466 s

===============================================================================
Small data, multiple small apertures   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
 227.71692 
 216.22896 
 215.76095 
 217.49997 

-------------------------------------------------------------------------------
Real time:     0.8775 s

===============================================================================
Big data, multiple small apertures   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
 219.69414 
 219.21515 
 221.50898 
 224.71499 

-------------------------------------------------------------------------------
Real time:     0.8855 s

===============================================================================
Big data, multiple big apertures   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
 108.48308 
 106.91285 
 108.60801 
 107.52988 

-------------------------------------------------------------------------------
Real time:     0.4318 s

===============================================================================
Big data, multiple small apertures, multiple per object   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
1651.24488 
1678.32494 
1712.43191 
1669.92998 

-------------------------------------------------------------------------------
Real time:     6.7122 s

Benchmarks after the API change and some bugfixes (still terrible results):

After commit c013ceca1de9ece4cb1cc8ef3a458ce16fe52124 in PR #68.

===============================================================================
Small data, single small aperture   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
   0.23521 
   0.21828 
   0.22359 
   0.21950 

-------------------------------------------------------------------------------
Real time:     0.8969 s

===============================================================================
Big data, single small aperture   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
   0.21999 
   0.21925 
   0.21912 
   0.21923 

-------------------------------------------------------------------------------
Real time:     0.8778 s

===============================================================================
Big data, single big aperture   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
   0.99361 
   0.96290 
   1.11749 
   1.21059 

-------------------------------------------------------------------------------
Real time:     0.0434 s

===============================================================================
Small data, multiple small apertures   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
10437.15715 
10862.54001 
10668.58411 
10410.96878 

-------------------------------------------------------------------------------
Real time:    42.3807 s

===============================================================================
Big data, multiple small apertures   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
10217.87190 
10077.44002 
10341.56704 
10353.68705 

-------------------------------------------------------------------------------
Real time:    40.9920 s

===============================================================================
Big data, multiple big apertures   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
 232.01203 
 228.70088 
 230.95989 
 220.44110 

-------------------------------------------------------------------------------
Real time:     0.9138 s

===============================================================================
Big data, multiple small apertures, multiple per object   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
109862.28395
...

Now, I managed to make the code even slower with changing the place of the loops:

Obviously this won't be committed, there are a few stashed copies only to know what to avoid...

===============================================================================
Small data, single small aperture   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
   1.08160 
   0.93383 
   0.92625 
   0.91250 

-------------------------------------------------------------------------------
Real time:     3.8544 s

===============================================================================
Big data, single small aperture   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
   0.95975 
   0.91790 
   0.91985 
   0.91352 

-------------------------------------------------------------------------------
Real time:     3.7113 s

===============================================================================
Big data, single big aperture   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
1891.39588 
1875.79451 
1456.97291 
1517.30680 

-------------------------------------------------------------------------------
Real time:    67.4154 s

===============================================================================
Small data, multiple small apertures   (milliseconds)
subpixels =
    1      
    5      
    10     
  exact    

-------------------------------------------------------------------------------
circ 
12679.45695 
13038.23519 
14621.58203 
12994.71903 

-------------------------------------------------------------------------------
Real time:    53.3345 s

===============================================================================
...
Clone this wiki locally