conbench-apache-arrow / Conbench performance report
succeeded
Aug 16, 2024 in 0s
Found 0 regressions
After merging your PR, Conbench analyzed the 7 benchmarking runs that have been run so far on merge-commit a970fd7.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
amd64-c6a-4xlarge-linux
at 2024-08-16 03:58:53Z - Commit Run on
arm64-t4g-2xlarge-linux
at 2024-08-16 04:17:14Z - Commit Run on
ec2-c6a-4xlarge-us-east-2
at 2024-08-16 04:13:34Z - Commit Run on
test-mac-arm
at 2024-08-16 04:13:53Z - Commit Run on
arm64-t4g-linux-compute
at 2024-08-16 04:23:32Z - Commit Run on
amd64-m5-4xlarge-linux
at 2024-08-16 04:11:03Z - Commit Run on
ec2-m5-4xlarge-us-east-2
at 2024-08-16 04:29:28Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
ec2-c6a-4xlarge-us-east-2
at 2024-08-16 04:13:34ZBenchmarkTemporalRounding
(C++) with params=<FloorTemporal, zoned, round_10_week>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBatchToTensorSimple
(C++) with params=/size:32768/num_columns:3, source=cpp-micro, suite=arrow-tensor-benchmarkBatchToTensorSimple
(C++) with params=/size:32768/num_columns:3, source=cpp-micro, suite=arrow-tensor-benchmarkBenchmarkTemporal
(C++) with params=<ISOWeek, zoned>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalRounding
(C++) with params=<FloorTemporal, zoned, round_1_week>/524288/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalRounding
(C++) with params=<FloorTemporal, zoned, round_1_week>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalRounding
(C++) with params=<FloorTemporal, zoned, round_10_week>/524288/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkInt64Conversion
(C++) with source=cpp-micro, suite=arrow-csv-converter-benchmarkBenchmarkTemporal
(C++) with params=<ISOWeek, zoned>/524288/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmark
-
Commit Run on
amd64-m5-4xlarge-linux
at 2024-08-16 04:11:03ZBM_DeltaBitPackingDecode_Int32_Fixed
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkBitmapVisitUInt8And
(C++) with params=32768/2, source=cpp-micro, suite=arrow-bit-util-benchmarkSpread Vector
(JavaScript) with from=uint8Array, source=js-microListSliceStringListView
(C++) with params=32768/10, source=cpp-micro, suite=arrow-compute-scalar-list-benchmarkBM_WriteColumn
(C++) with params=<false,DoubleType>, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkBenchmarkStrftime
(C++) with params=<non_zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_RleEncodingBoolean
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkSpread Vector
(JavaScript) with from=int64Array, source=js-microRoundArrayBenchmark
(C++) with params=<Round, UInt64Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkExecuteScalarExpressionOverhead
(C++) with params=complex_integer_expression/rows_per_batch:1000000/real_time/threads:1, source=cpp-micro, suite=arrow-acero-expression-benchmarkSpread Vector
(JavaScript) with from=int32Array, source=js-microBM_DictDecodingInt64_repeats
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkSlice toArray vectors
(JavaScript) with column=destination, dataset=tracks, length=1,000,000, source=js-micro, type=Dictionary<Int8, Utf8>BM_DecodeArrowBooleanRle
(C++) with params=DecodeArrowWithNull/num_values:4096/null_in_ten_thousand:100, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DeltaDecodingByteArray
(C++) with params=max-string-length:8/batch-size:512/prefixed-percent:99, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkTemporalBinary
(C++) with params=<DaysBetween, date64_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_ArrowBinaryDict
(C++) with params=DecodeArrow_Dense/32768, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DecodeArrowBooleanRle
(C++) with params=DecodeArrowWithNull/num_values:65536/null_in_ten_thousand:1, source=cpp-micro, suite=parquet-encoding-benchmarkShortVectorInsert
(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkReadFileMetadata
(C++) with params=num_columns:10/num_row_groups:1000, source=cpp-micro, suite=parquet-metadata-benchmarkBM_ArrowBinaryDict
(C++) with params=EncodeArrow/262144, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkBitmapVisitUInt8And
(C++) with params=131072/2, source=cpp-micro, suite=arrow-bit-util-benchmarkArraySortIndicesInt64WideDict
(C++) with params=32768/10000, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkDoubleRowMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkSpread Vector
(JavaScript) with from=dictionary, source=js-microUniqueUInt8
(C++) with params=1, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkSimplifyFilterWithGuarantee
(C++) with params=negative_filter_cast_guarantee_dictionary, source=cpp-micro, suite=arrow-acero-expression-benchmarkBM_ArrowBinaryDict
(C++) with params=DecodeArrowNonNull_Dict/65536, source=cpp-micro, suite=parquet-encoding-benchmarkBitRunReader
(C++) with params=25, source=cpp-micro, suite=arrow-bit-util-benchmarkRecordReaderSkipRecords
(C++) with params=Repetition:0/BatchSize:1000, source=cpp-micro, suite=parquet-column-reader-benchmarkBM_BatchComputeHash
(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkloadBenchmark
(Java) with source=java-micro, suite=arrow.vector.VectorLoaderBenchmarkBM_RleEncodingSpacedBoolean
(C++) with params=32768/100, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ArrowBinaryDict
(C++) with params=DecodeArrowNonNull_Dense/32768, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkTemporalBinary
(C++) with params=<DayTimeBetween, zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkRoundDerivativesArrayBenchmark
(C++) with params=<Ceil, DoubleType>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkFilterFixedSizeBinaryFilterWithNulls
(C++) with params=1048576/0/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkSimplifyFilterWithGuarantee
(C++) with params=positive_filter_simple_guarantee_dictionary, source=cpp-micro, suite=arrow-acero-expression-benchmarkSpread Vector
(JavaScript) with from=uint16Array, source=js-microBenchmarkTemporalBinary
(C++) with params=<MinutesBetween, zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_ArrowBinaryDict
(C++) with params=DecodeArrow_Dense/4096, source=cpp-micro, suite=parquet-encoding-benchmarkBM_RleEncodingBoolean
(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DeltaDecodingByteArray
(C++) with params=max-string-length:8/batch-size:512/prefixed-percent:90, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DeltaBitPackingEncode_Int32_Fixed
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ArrowBinaryDict
(C++) with params=DecodeArrowNonNull_Dense/65536, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DictDecodingInt64_repeats
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ArrowBinaryDict
(C++) with params=DecodeArrow_Dense/1024, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkTemporalBinary
(C++) with params=<MonthsBetween, zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalBinary
(C++) with params=<YearsBetween, zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarktoArray Vector
(JavaScript) with from=dictionary, source=js-microBM_RleEncodingSpacedBoolean
(C++) with params=32768/1000, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkTemporalBinary
(C++) with params=<QuartersBetween, zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalBinary
(C++) with params=<MonthDayNanoBetween, date64_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkUniqueUInt8
(C++) with params=0, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkRecordReaderReadAndSkipRecords
(C++) with params=Repetition:1/BatchSize:10/LevelsPerPage:80000, source=cpp-micro, suite=parquet-column-reader-benchmarkBM_ArrowBinaryDict
(C++) with params=DecodeArrowNonNull_Dense/4096, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DeltaEncodingByteArray
(C++) with params=max-string-length:64/batch-size:2048/prefixed-percent:90, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkTemporalBinary
(C++) with params=<HoursBetween, time64_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalBinary
(C++) with params=<MinutesBetween, date64_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_BatchComputeHash
(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarktoArray Vector
(JavaScript) with from=utf8, source=js-microBM_ArrowBinaryPlain
(C++) with params=DecodeArrow_Dense/65536, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkTemporalRounding
(C++) with params=<CeilTemporal, non_zoned, round_1_week>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalBinary
(C++) with params=<NanosecondsBetween, time32_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkSpread vectors
(JavaScript) with column=destination, dataset=tracks, length=1,000,000, source=js-micro, type=Dictionary<Int8, Utf8>Spread Vector
(JavaScript) with from=uint64Array, source=js-microBM_ByteStreamSplitEncode_FLBA_Generic
(C++) with params=<7>/65536, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkTemporal
(C++) with params=<IsLeapYear, non_zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalBinary
(C++) with params=<DayTimeBetween, zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_DeltaEncodingByteArray
(C++) with params=max-string-length:1024/batch-size:2048/prefixed-percent:99, source=cpp-micro, suite=parquet-encoding-benchmarkFilterRecordBatchWithNulls
(C++) with params=100/3, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkFilterInt64FilterNoNulls
(C++) with params=1048576/0, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkReadCompressedBuffer
(C++) with params=num_cols:64/is_partial:0/real_time, source=cpp-micro, suite=arrow-ipc-read-write-benchmarkListSliceStringListView
(C++) with params=32768/10000, source=cpp-micro, suite=arrow-compute-scalar-list-benchmarkBM_DeltaBitPackingDecode_Int64_Wide
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkBitmapReaderSumWithOffset
(C++) with params=8, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkGetFilteredFragments
(C++) with params=single_file, source=cpp-micro, suite=arrow-dataset-file-benchmarkSlice toArray vectors
(JavaScript) with column=origin, dataset=tracks, length=1,000,000, source=js-micro, type=Dictionary<Int8, Utf8>ParseJSONFields
(C++) with params=ordered:0/schema:0/sparsity:90/num_fields:100, source=cpp-micro, suite=arrow-json-parser-benchmarkBM_DeltaBitPackingDecode_Int32_Fixed
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkStrftime
(C++) with params=/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkSpread Vector
(JavaScript) with from=float64Array, source=js-microBM_DeltaBitPackingDecode_Int64_Wide
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkLongVectorInsertAtEnd
(C++) with params=<STD_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBenchmarkTemporalBinary
(C++) with params=<MinutesBetween, time64_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_DeltaEncodingByteArray
(C++) with params=max-string-length:8/batch-size:2048/prefixed-percent:99, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ArrowBinaryDict
(C++) with params=DecodeArrowNonNull_Dense/1024, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkTemporalBinary
(C++) with params=<HoursBetween, time64_type>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkReadFileMetadata
(C++) with params=num_columns:10/num_row_groups:100, source=cpp-micro, suite=parquet-metadata-benchmarkBM_DeltaEncodingByteArray
(C++) with params=max-string-length:1024/batch-size:512/prefixed-percent:99, source=cpp-micro, suite=parquet-encoding-benchmarkDoubleColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkExecuteScalarExpressionOverhead
(C++) with params=simple_expression/rows_per_batch:10000/real_time/threads:1, source=cpp-micro, suite=arrow-acero-expression-benchmarkBM_DefinitionLevelsToBitmapRepeatedMostPresent
(C++) with source=cpp-micro, suite=parquet-level-conversion-benchmarkBM_RleDecoding
(C++) with params=32768/16, source=cpp-micro, suite=parquet-column-io-benchmarkBM_PlainDecodingSpacedByteArray
(C++) with params=max-string-length:1024/batch-size:2048, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ByteStreamSplitEncode_Float_Scalar
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkSpread vectors
(JavaScript) with column=origin, dataset=tracks, length=1,000,000, source=js-micro, type=Dictionary<Int8, Utf8>BM_DeltaEncodingByteArray
(C++) with params=max-string-length:1024/batch-size:512/prefixed-percent:90, source=cpp-micro, suite=parquet-encoding-benchmarkSpread Vector
(JavaScript) with from=booleans, source=js-microBenchmarkTemporalBinary
(C++) with params=<MonthDayNanoBetween, zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_ArrowBinaryPlain
(C++) with params=DecodeArrow_Dense/32768, source=cpp-micro, suite=parquet-encoding-benchmarkShortVectorInsertAtEnd
(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBenchmarkTemporalBinary
(C++) with params=<MicrosecondsBetween, zoned>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_RleEncodingBoolean
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkListSliceStringListView
(C++) with params=32768/100, source=cpp-micro, suite=arrow-compute-scalar-list-benchmarkBM_ArrowBinaryPlain
(C++) with params=EncodeArrow/1048576, source=cpp-micro, suite=parquet-encoding-benchmarkFilterRecordBatchWithNulls
(C++) with params=10/3, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkSpread Vector
(JavaScript) with from=int16Array, source=js-microBenchmarkTemporalBinary
(C++) with params=<NanosecondsBetween, zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkSetBitRunReader
(C++) with params=0, source=cpp-micro, suite=arrow-bit-util-benchmarkBM_RleEncodingBoolean
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkReadBufferAsync
(C++) with params=num_cols:64/is_partial:1/real_time, source=cpp-micro, suite=arrow-ipc-read-write-benchmarkBM_ReadOffsetIndex
(C++) with params=num_pages:512, source=cpp-micro, suite=parquet-page-index-benchmarkSpread Vector
(JavaScript) with from=uint32Array, source=js-microBM_PlainDecodingSpacedBoolean
(C++) with params=32768/5000, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkStrftime
(C++) with params=/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalBinary
(C++) with params=<WeeksBetween, non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkFilterOverhead
(C++) with params=selectivity_benchmark/batch_size:1000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkBM_DeltaBitPackingDecode_Int64_Wide
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkSpread Vector
(JavaScript) with from=utf8, source=js-microBM_DecodeArrowBooleanRle
(C++) with params=DecodeArrowWithNull/num_values:16384/null_in_ten_thousand:1, source=cpp-micro, suite=parquet-encoding-benchmarkSpread Vector
(JavaScript) with from=int8Array, source=js-microBenchmarkStrftime
(C++) with params=<non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkFilterRecordBatchWithNulls
(C++) with params=10/0, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkDecodeStream
(C++) with params=16/real_time, source=cpp-micro, suite=arrow-ipc-read-write-benchmarkBM_DeltaEncodingByteArray
(C++) with params=max-string-length:64/batch-size:512/prefixed-percent:90, source=cpp-micro, suite=parquet-encoding-benchmarkScanOnlyBench
(C++) with params=num_batches:1000/batch_size:10/scan_alg:0/real_time, source=cpp-micro, suite=arrow-dataset-scanner-benchmarkBM_WriteColumn
(C++) with params=<false,BooleanType>, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkSimplifyFilterWithGuarantee
(C++) with params=positive_filter_cast_guarantee_dictionary, source=cpp-micro, suite=arrow-acero-expression-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFilterRecordBatchWithNulls
(C++) with params=50/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBenchmarkTemporalRounding
(C++) with params=<FloorTemporal, zoned, round_10_month>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_DeltaEncodingByteArray
(C++) with params=max-string-length:64/batch-size:512/prefixed-percent:99, source=cpp-micro, suite=parquet-encoding-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading