Logs: add Pipelines as Logpush destination#29469
Draft
Marcinthecloud wants to merge 1 commit intoproductionfrom
Draft
Logs: add Pipelines as Logpush destination#29469Marcinthecloud wants to merge 1 commit intoproductionfrom
Marcinthecloud wants to merge 1 commit intoproductionfrom
Conversation
Contributor
|
This pull request requires reviews from CODEOWNERS as it changes files that match the following patterns:
|
Contributor
Author
|
/bonk review this, ensuring that:
fix trivial examples, and make suggestions on the PR otherwise. |
![ask-bonk[bot]](https://avatars.githubusercontent.com/in/2454580?s=60&v=4){kind=small}
| WHERE EdgeResponseStatus >= 400; | ||
| ``` | ||
|
|
||
| Pipelines SQL supports string functions, regex, hashing (SHA-256, MD5), JSON extraction, timestamp conversion, conditional expressions, and more. For the full list, refer to the [Pipelines SQL reference](/pipelines/sql-reference/). |
Contributor
There was a problem hiding this comment.
Per the style guide, use 'Refer to' instead of 'See':
Suggested change
| Pipelines SQL supports string functions, regex, hashing (SHA-256, MD5), JSON extraction, timestamp conversion, conditional expressions, and more. For the full list, refer to the [Pipelines SQL reference](/pipelines/sql-reference/). | |
| Pipelines SQL supports string functions, regex, hashing (SHA-256, MD5), JSON extraction, timestamp conversion, conditional expressions, and more. For the full list, refer to the [Pipelines SQL reference](/pipelines/sql-reference/). |
| - Choose the file format: Raw Parquet, JSON, or [R2 Data Catalog (Apache Iceberg)](/r2/data-catalog/). | ||
| - Optionally, you can edit advanced settings such as rolling policy, partitioning, and compression. For more information about these settings, refer to the [Pipelines Sinks documentation](/pipelines/sinks/). | ||
|
|
||
| 7. Select **Generate token** to automatically create a token that will be used for authentication to R2, R2 Data Catalog, and the Pipelines Stream. |
Contributor
There was a problem hiding this comment.
Bold the UI element:
Suggested change
| 7. Select **Generate token** to automatically create a token that will be used for authentication to R2, R2 Data Catalog, and the Pipelines Stream. | |
| 7. Select **Generate token** to automatically create a token that will be used for authentication to R2, R2 Data Catalog, and the Pipelines Stream. |
Contributor
|
Posted 2 inline suggestions on PR #29469:
The documentation is well-structured with proper frontmatter, correct component usage ( |
Contributor
garvit-gupta
reviewed
Apr 1, 2026
|
|
||
| 3. Select **Pipelines** as the destination. | ||
|
|
||
| 4. Select the dataset from the dropdown. The schema for the respective dataset will automatically be applied to the Pipeline that is created. |
Contributor
There was a problem hiding this comment.
Should we mention that the Pipelines creation wizard would open on clicking the create button?
|
|
||
| For a full list of fields available in each dataset, refer to [Datasets](/logs/logpush/logpush-job/datasets/). | ||
|
|
||
| ## Manage via the Cloudflare dashboard |
Contributor
There was a problem hiding this comment.
Would it help to have some screenshots here?
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds documentation for using Cloudflare Pipelines as a native Logpush destination, enabling SQL transformation of logs before storage in R2.