Skip to contents

Internal helper functions used by the consolidation family of functions. These functions provide shared aggregation logic for merging employment periods with exceptional performance (9x faster than previous implementations).

Details

The consolidation helpers implement a highly optimized aggregation engine that:

  • Uses vectorized operations throughout (no loops)

  • Preserves all column types (Date, IDate, integer, numeric, character, factor, logical)

  • Handles weighted aggregation for qualitative and quantitative variables

  • Scales efficiently to 10M+ employment records

Performance characteristics:

  • Full consolidation chain: ~41,000 records/second

  • 9x faster than baseline through pre-aggregation optimization

  • Memory efficient: < 1x input size