Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 [firestore-bigquery-export] Time unit partition field not assigned in BQ for delete operations #2303

Open
pldelattre opened this issue Feb 23, 2025 · 1 comment
Labels
extension: firestore-bigquery-export Related to firestore-bigquery-export extension type: bug Something isn't working

Comments

@pldelattre
Copy link

[REQUIRED] Step 2: Describe your configuration

  • Extension name: firestore-bigquery-export
  • Extension version: 0.1.58

[REQUIRED] Step 3: Describe the problem

Steps to reproduce:

Activate the extension with a custom time unit partition field
Create and delete some records in firestore and look if partition field is correctly assigned in BQ in the raw_changelog table

Expected result

custom partition field should be assigned on each raw_changelog record

Actual result

It is only assigned on CREATE and UPDATE but not on DELETE Operations

Image
How to fix ?

For DELETE operation, the custom partition field could be populated from old_data json

@pldelattre pldelattre added the type: bug Something isn't working label Feb 23, 2025
@cabljac
Copy link
Contributor

cabljac commented Feb 24, 2025

Hi! thanks for raising this. It's been received and we're investigating. I'll provide an update as soon as possible.

@cabljac cabljac added the extension: firestore-bigquery-export Related to firestore-bigquery-export extension label Feb 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
extension: firestore-bigquery-export Related to firestore-bigquery-export extension type: bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants