Skip to content

Instantly share code, notes, and snippets.

@commonlisp
Created November 19, 2013 15:37
Show Gist options
  • Save commonlisp/7547232 to your computer and use it in GitHub Desktop.
Save commonlisp/7547232 to your computer and use it in GitHub Desktop.
test_perf.sh -b c70882a -t 83a4b03
Invoked with :
--ncalls: 3
--repeats: 3
-------------------------------------------------------------------------------
Test name | head[ms] | base[ms] | ratio |
-------------------------------------------------------------------------------
frame_isnull | 1.8473 | 2.0307 | 0.9097 |
stat_ops_level_series_sum_multiple | 10.7200 | 11.6096 | 0.9234 |
datetimeindex_normalize | 3.7840 | 4.0383 | 0.9370 |
frame_mask_bools | 45.1563 | 47.3570 | 0.9535 |
dti_reset_index_tz | 16.5880 | 17.3600 | 0.9555 |
stat_ops_frame_sum_float_axis_1 | 7.2243 | 7.4960 | 0.9638 |
groupby_indices | 9.8783 | 10.1709 | 0.9712 |
series_getitem_scalar | 0.0123 | 0.0126 | 0.9748 |
datamatrix_getitem_scalar | 0.0126 | 0.0130 | 0.9755 |
frame_to_csv2 | 140.8443 | 144.1300 | 0.9772 |
groupby_frame_median | 9.0430 | 9.2424 | 0.9784 |
frame_reindex_upcast | 19.2033 | 19.5957 | 0.9800 |
stat_ops_frame_mean_float_axis_0 | 6.9307 | 7.0643 | 0.9811 |
lib_fast_zip_fillna | 18.3440 | 18.6753 | 0.9823 |
groupby_simple_compress_timing | 41.4863 | 42.2053 | 0.9830 |
groupby_multi_different_functions | 17.1734 | 17.4583 | 0.9837 |
series_drop_duplicates_string | 0.7240 | 0.7360 | 0.9837 |
append_frame_single_mixed | 1.3073 | 1.3251 | 0.9866 |
ctor_index_array_string | 0.0244 | 0.0247 | 0.9871 |
groupby_multi_python | 165.0477 | 167.1706 | 0.9873 |
frame_to_csv | 161.1133 | 163.1690 | 0.9874 |
frame_reindex_axis0 | 186.2370 | 188.4130 | 0.9885 |
groupby_frame_apply_overhead | 15.2241 | 15.3950 | 0.9889 |
frame_drop_dup_inplace | 3.8003 | 3.8407 | 0.9895 |
packers_read_pack | 6.5343 | 6.5966 | 0.9905 |
frame_get_numeric_data | 0.1267 | 0.1277 | 0.9919 |
frame_reindex_axis1 | 720.9357 | 726.4567 | 0.9924 |
join_dataframe_index_single_key_small | 10.6897 | 10.7650 | 0.9930 |
frame_drop_dup_na_inplace | 3.4797 | 3.5037 | 0.9931 |
groupby_first_float32 | 4.7890 | 4.8199 | 0.9936 |
timeseries_timestamp_downsample_mean | 6.5037 | 6.5456 | 0.9936 |
timeseries_asof_nan | 9.5590 | 9.6180 | 0.9939 |
timeseries_asof | 10.4157 | 10.4783 | 0.9940 |
reshape_pivot_time_series | 244.6217 | 246.0853 | 0.9941 |
groupby_pivot_table | 27.3767 | 27.5207 | 0.9948 |
stat_ops_level_frame_sum | 4.1846 | 4.2063 | 0.9948 |
frame_assign_timeseries_index | 1.2674 | 1.2733 | 0.9953 |
datetime_index_union | 0.0947 | 0.0950 | 0.9958 |
timeseries_1min_5min_ohlc | 0.8010 | 0.8043 | 0.9959 |
groupby_first | 4.9117 | 4.9317 | 0.9959 |
timeseries_sort_index | 24.0720 | 24.1636 | 0.9962 |
series_align_irregular_string | 77.5754 | 77.8660 | 0.9963 |
frame_drop_duplicates_na | 24.1460 | 24.2337 | 0.9964 |
frame_mult_st | 10.1883 | 10.2233 | 0.9966 |
groupby_frame_apply | 73.6880 | 73.9217 | 0.9968 |
frame_ctor_nested_dict | 91.9720 | 92.2614 | 0.9969 |
groupby_multi_size | 37.0260 | 37.1410 | 0.9969 |
period_setitem | 286.6976 | 287.5783 | 0.9969 |
frame_boolean_row_select | 0.4427 | 0.4440 | 0.9970 |
read_csv_standard | 14.3900 | 14.4327 | 0.9970 |
series_value_counts_int64 | 3.2570 | 3.2667 | 0.9971 |
packers_write_pickle | 8.0446 | 8.0677 | 0.9971 |
stat_ops_frame_sum_int_axis_0 | 7.4470 | 7.4656 | 0.9975 |
frame_add_no_ne | 10.2167 | 10.2413 | 0.9976 |
stats_corr_spearman | 98.7023 | 98.9354 | 0.9976 |
sort_level_one | 7.2866 | 7.3036 | 0.9977 |
merge_2intkey_nosort | 26.3130 | 26.3730 | 0.9977 |
stat_ops_frame_sum_int_axis_1 | 8.2287 | 8.2467 | 0.9978 |
frame_drop_duplicates | 25.2397 | 25.2923 | 0.9979 |
panel_from_dict_equiv_indexes | 46.8620 | 46.9584 | 0.9979 |
frame_iloc_dups | 0.4033 | 0.4040 | 0.9982 |
sort_level_zero | 5.8526 | 5.8630 | 0.9982 |
eval_frame_and_python_one_thread | 56.7907 | 56.8854 | 0.9983 |
reindex_fillna_backfill_float32 | 0.4674 | 0.4680 | 0.9986 |
frame_mask_floats | 27.4010 | 27.4343 | 0.9988 |
datetimeindex_add_offset | 0.2627 | 0.2630 | 0.9988 |
panel_from_dict_two_different_indexes | 76.0940 | 76.1846 | 0.9988 |
frame_sort_index_by_columns | 48.1640 | 48.2193 | 0.9989 |
groupby_frame_singlekey_integer | 3.2273 | 3.2310 | 0.9989 |
frame_fancy_lookup_all | 26.6423 | 26.6710 | 0.9989 |
panel_from_dict_all_different_indexes | 103.0351 | 103.1460 | 0.9989 |
dti_reset_index | 0.3064 | 0.3067 | 0.9990 |
panel_from_dict_same_index | 46.8230 | 46.8706 | 0.9990 |
packers_write_csv | 720.6759 | 721.2604 | 0.9992 |
indexing_dataframe_boolean_rows | 0.4027 | 0.4030 | 0.9992 |
reindex_frame_level_align | 1.7924 | 1.7936 | 0.9993 |
reindex_fillna_pad | 0.4876 | 0.4880 | 0.9993 |
indexing_dataframe_boolean_st | 142.7420 | 142.8333 | 0.9994 |
index_datetime_union | 12.0837 | 12.0900 | 0.9995 |
frame_add_st | 10.2516 | 10.2567 | 0.9995 |
frame_to_csv_date_formatting | 23.5647 | 23.5703 | 0.9998 |
frame_fillna_many_columns_pad | 15.4877 | 15.4903 | 0.9998 |
stat_ops_frame_mean_int_axis_1 | 8.3884 | 8.3893 | 0.9999 |
indexing_dataframe_boolean | 140.9847 | 140.9963 | 0.9999 |
frame_multi_and_st | 113.9603 | 113.9660 | 1.0000 |
index_int64_union | 89.7340 | 89.7384 | 1.0000 |
groupby_multi_different_numpy_functions | 17.1657 | 17.1661 | 1.0000 |
frame_xs_col | 0.0486 | 0.0486 | 1.0000 |
frame_xs_row | 0.0670 | 0.0670 | 1.0000 |
append_frame_single_homogenous | 0.3260 | 0.3260 | 1.0000 |
timeseries_large_lookup_value | 0.0424 | 0.0424 | 1.0000 |
timestamp_series_compare | 4.5587 | 4.5583 | 1.0001 |
frame_reindex_both_axes | 43.3480 | 43.3427 | 1.0001 |
frame_fillna_inplace | 15.0050 | 15.0030 | 1.0001 |
frame_multi_and_no_ne | 114.5643 | 114.5484 | 1.0001 |
concat_small_frames | 21.0653 | 21.0597 | 1.0003 |
timeseries_period_downsample_mean | 14.7517 | 14.7456 | 1.0004 |
indexing_panel_subset | 0.7436 | 0.7433 | 1.0004 |
stats_rank_average_int | 24.1226 | 24.1110 | 1.0005 |
reindex_fillna_backfill | 0.6410 | 0.6407 | 1.0005 |
frame_getitem_single_column2 | 37.1500 | 37.1293 | 1.0006 |
indexing_dataframe_boolean_no_ne | 141.1860 | 141.1030 | 1.0006 |
datetime_index_intersection | 0.3973 | 0.3970 | 1.0006 |
eval_frame_mult_python_one_thread | 31.5523 | 31.5333 | 1.0006 |
groupby_last | 4.9303 | 4.9273 | 1.0006 |
timeseries_to_datetime_iso8601 | 5.4177 | 5.4143 | 1.0006 |
datetimeindex_infer_dst | 4.7087 | 4.7057 | 1.0006 |
frame_multi_and | 114.0857 | 114.0093 | 1.0007 |
frame_insert_100_columns_begin | 28.2873 | 28.2640 | 1.0008 |
stats_rank2d_axis1_average | 16.7394 | 16.7240 | 1.0009 |
frame_to_string_floats | 50.1157 | 50.0633 | 1.0010 |
merge_2intkey_sort | 49.2947 | 49.2404 | 1.0011 |
stat_ops_frame_sum_float_axis_0 | 6.9030 | 6.8953 | 1.0011 |
melt_dataframe | 2.7880 | 2.7847 | 1.0012 |
eval_frame_add_python | 32.2690 | 32.2307 | 1.0012 |
frame_mult | 10.1887 | 10.1747 | 1.0014 |
frame_add | 10.2503 | 10.2357 | 1.0014 |
packers_read_pickle | 1.2720 | 1.2700 | 1.0016 |
frame_reindex_both_axes_ix | 40.0967 | 40.0340 | 1.0016 |
groupby_multi_series_op | 19.2600 | 19.2284 | 1.0016 |
frame_insert_500_columns_end | 148.2567 | 147.9770 | 1.0019 |
stats_rank2d_axis0_average | 28.8864 | 28.8287 | 1.0020 |
index_int64_intersection | 34.6611 | 34.5910 | 1.0020 |
join_dataframe_index_multi | 28.8476 | 28.7850 | 1.0022 |
index_datetime_intersection | 12.1160 | 12.0896 | 1.0022 |
timeseries_infer_freq | 12.5047 | 12.4770 | 1.0022 |
frame_repr_tall | 3.3350 | 3.3267 | 1.0025 |
frame_mult_no_ne | 10.2093 | 10.1840 | 1.0025 |
frame_loc_dups | 1.0800 | 1.0773 | 1.0025 |
dataframe_reindex | 0.5263 | 0.5250 | 1.0026 |
join_dataframe_integer_key | 2.3344 | 2.3280 | 1.0027 |
groupby_transform | 215.3093 | 214.6937 | 1.0029 |
frame_repr_wide | 1.2543 | 1.2507 | 1.0029 |
read_table_multiple_date_baseline | 129.1483 | 128.7480 | 1.0031 |
read_parse_dates_iso8601 | 1.5743 | 1.5694 | 1.0031 |
eval_frame_add_python_one_thread | 31.7140 | 31.6133 | 1.0032 |
series_align_left_monotonic | 18.4134 | 18.3504 | 1.0034 |
timeseries_add_irregular | 23.8670 | 23.7833 | 1.0035 |
series_align_int64_index | 38.7030 | 38.5606 | 1.0037 |
frame_fancy_lookup | 4.8637 | 4.8457 | 1.0037 |
join_dataframe_index_single_key_bigger_sort | 21.2403 | 21.1603 | 1.0038 |
timeseries_timestamp_tzinfo_cons | 0.0203 | 0.0203 | 1.0039 |
stat_ops_frame_mean_int_axis_0 | 7.3626 | 7.3337 | 1.0039 |
groupby_sum_booleans | 1.3797 | 1.3740 | 1.0042 |
reindex_frame_level_reindex | 1.7107 | 1.7033 | 1.0043 |
reindex_daterange_pad | 2.0266 | 2.0177 | 1.0045 |
join_dataframe_integer_2key | 7.1887 | 7.1566 | 1.0045 |
frame_iteritems_cached | 0.8466 | 0.8427 | 1.0046 |
sparse_series_to_frame | 201.4407 | 200.4763 | 1.0048 |
series_drop_duplicates_int | 0.9157 | 0.9110 | 1.0051 |
reindex_fillna_pad_float32 | 0.4510 | 0.4486 | 1.0053 |
frame_get_dtype_counts | 0.1344 | 0.1337 | 1.0054 |
series_ctor_from_dict | 3.3037 | 3.2860 | 1.0054 |
read_table_multiple_date | 275.6236 | 274.1357 | 1.0054 |
timeseries_to_datetime_YYYYMMDD | 14.4063 | 14.3270 | 1.0055 |
dataframe_getitem_scalar | 0.0127 | 0.0126 | 1.0063 |
stat_ops_series_std | 1.1047 | 1.0977 | 1.0064 |
reindex_daterange_backfill | 1.6363 | 1.6257 | 1.0066 |
groupby_multi_cython | 22.9180 | 22.7670 | 1.0066 |
match_strings | 0.5987 | 0.5944 | 1.0072 |
stats_rank_average | 34.3910 | 34.1296 | 1.0077 |
frame_constructor_ndarray | 0.0683 | 0.0677 | 1.0082 |
read_csv_comment2 | 33.2283 | 32.9433 | 1.0087 |
join_dataframe_index_single_key_bigger | 11.2983 | 11.2007 | 1.0087 |
frame_ctor_nested_dict_int64 | 127.5220 | 126.4100 | 1.0088 |
frame_ctor_list_of_dict | 94.4647 | 93.6400 | 1.0088 |
frame_iteritems | 50.8187 | 50.3527 | 1.0093 |
timeseries_1min_5min_mean | 0.7956 | 0.7883 | 1.0093 |
frame_reindex_columns | 0.4667 | 0.4621 | 1.0100 |
eval_frame_chained_cmp_python_one_thread | 96.8393 | 95.8637 | 1.0102 |
concat_series_axis1 | 127.1596 | 125.8534 | 1.0104 |
series_timestamp_compare | 4.5993 | 4.5500 | 1.0108 |
timeseries_slice_minutely | 0.0927 | 0.0916 | 1.0113 |
reshape_unstack_simple | 4.0526 | 4.0069 | 1.0114 |
unstack_sparse_keyspace | 2.1366 | 2.1100 | 1.0126 |
series_constructor_ndarray | 0.0246 | 0.0243 | 1.0131 |
frame_to_csv_mixed | 261.1373 | 257.7356 | 1.0132 |
packers_read_csv | 62.9343 | 62.0449 | 1.0143 |
lib_fast_zip | 15.2307 | 15.0043 | 1.0151 |
groupby_apply_dict_return | 49.1997 | 48.4620 | 1.0152 |
read_csv_vb | 27.2884 | 26.8550 | 1.0161 |
reindex_multiindex | 1.9577 | 1.9263 | 1.0163 |
indexing_dataframe_boolean_rows_object | 0.6510 | 0.6404 | 1.0165 |
groupby_last_float32 | 5.0257 | 4.9396 | 1.0174 |
datetimeindex_unique | 0.1650 | 0.1620 | 1.0181 |
packers_write_pack | 16.9373 | 16.6353 | 1.0182 |
timeseries_asof_single | 0.0494 | 0.0484 | 1.0197 |
read_csv_thou_vb | 23.9797 | 23.4811 | 1.0212 |
reshape_stack_simple | 2.4390 | 2.3863 | 1.0221 |
stat_ops_level_frame_sum_multiple | 11.8670 | 11.5850 | 1.0243 |
groupby_series_simple_cython | 6.6513 | 6.4930 | 1.0244 |
write_csv_standard | 55.3167 | 53.9010 | 1.0263 |
stat_ops_frame_mean_float_axis_1 | 8.8783 | 8.5560 | 1.0377 |
frame_getitem_single_column | 36.6710 | 35.2370 | 1.0407 |
sparse_frame_constructor | 17.3660 | 16.5927 | 1.0466 |
series_string_vector_slice | 261.0957 | 246.7247 | 1.0582 |
stat_ops_level_series_sum | 3.3343 | 3.1260 | 1.0666 |
stats_rolling_mean | 1.7050 | 1.5663 | 1.0885 |
groupby_frame_cython_many_columns | 5.7536 | 5.2633 | 1.0931 |
replace_replacena | 2.9504 | 2.6763 | 1.1024 |
replace_fillna | 2.8447 | 2.5744 | 1.1050 |
series_value_counts_strings | 11.9543 | 6.3783 | 1.8742 |
-------------------------------------------------------------------------------
Test name | head[ms] | base[ms] | ratio |
-------------------------------------------------------------------------------
Ratio < 1.0 means the target commit is faster then the baseline.
Seed used: 1234
Target [83a4b03] : BUG/TST: Fixes isnull behavior on NaT in array. Closes #5443
Added a test case test_isnull_nat() to test_common.py and check for NaT in lib.isnullobj. pd.isnull(np.array([pd.NaT])) now yields the correct results ([True]).
Base [c70882a] : Merge pull request #5510 from hayd/groupby_cumcount
ENH add cumcount groupby method
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment