Time series use case #3502

mneedham · 2025-03-14T11:01:43Z

Time-series use case

vercel · 2025-03-14T11:01:47Z

@mneedham is attempting to deploy a commit to the ClickHouse Team on Vercel.

A member of the Team first needs to authorize it.

vercel · 2025-03-14T11:02:13Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

2 Skipped Deployments

Name	Status	Preview	Comments	Updated (UTC)
clickhouse-docs-ru	⬜️ Ignored (Inspect)	Visit Preview		Mar 14, 2025 0:21am
clickhouse-docs-zh	⬜️ Ignored (Inspect)	Visit Preview		Mar 14, 2025 0:21am

Blargian

LGTM. Left a few comments.

Blargian · 2025-03-15T10:03:24Z

docs/use-cases/time-series/analysis-functions.md

+title: Analysis functions- Time-series
+sidebar_label: Analysis functions
+description: Functions for analyzing time-series data in ClickHouse.
+slug: /use-cases/time-series/analysis-functions
+keywords: [time-series]


Suggested change

title: Analysis functions- Time-series

sidebar_label: Analysis functions

description: Functions for analyzing time-series data in ClickHouse.

slug: /use-cases/time-series/analysis-functions

keywords: [time-series]

title: 'Analysis functions - Time-series'

sidebar_label: 'Analysis functions'

description: 'Functions for analyzing time-series data in ClickHouse.'

slug: /use-cases/time-series/analysis-functions

keywords: ['time-series']

Added a check on the front-matter yesterday that enforces having title, description, slug and single quotes.

Blargian · 2025-03-15T10:03:57Z

docs/use-cases/time-series/basic-operations.md

+title: Basic operations - Time-series
+sidebar_label: Basic operations
+description: Basic time-series operations in ClickHouse.
+slug: /use-cases/time-series/basic-operations
+keywords: [time-series]


Suggested change

title: Basic operations - Time-series

sidebar_label: Basic operations

description: Basic time-series operations in ClickHouse.

slug: /use-cases/time-series/basic-operations

keywords: [time-series]

title: 'Basic operations - Time-series'

sidebar_label: 'Basic operations'

description: 'Basic time-series operations in ClickHouse.'

slug: /use-cases/time-series/basic-operations

keywords: ['time-series']

Blargian · 2025-03-15T10:04:24Z

docs/use-cases/time-series/date-time-data-types.md

+title: Date and time data types - Time-series
+sidebar_label: Date and time data types
+description: Time-series data types in ClickHouse.
+slug: /use-cases/time-series/date-time-data-types
+keywords: [time-series]


Suggested change

title: Date and time data types - Time-series

sidebar_label: Date and time data types

description: Time-series data types in ClickHouse.

slug: /use-cases/time-series/date-time-data-types

keywords: [time-series]

title: 'Date and time data types - Time-series'

sidebar_label: 'Date and time data types'

description: 'Time-series data types in ClickHouse.'

slug: /use-cases/time-series/date-time-data-types

keywords: ['time-series']

Blargian · 2025-03-15T10:05:33Z

docs/use-cases/time-series/index.md

+slug: /use-cases/time-series
+title: Time-Series
+pagination_prev: null
+pagination_next: null


Suggested change

slug: /use-cases/time-series

title: Time-Series

pagination_prev: null

pagination_next: null

description: 'Index page for the time-series use-case guide.'

slug: /use-cases/time-series

title: 'Time-Series'

pagination_prev: null

pagination_next: null

Let's call this page "introduction" rather and have it as the first sub-menu item? Similar to how it is in the Observability guide. Then we can add an index.md which gets a table of contents automatically generated from the titles and descriptions in the yaml front matter at build time. See here for example.

To do that we leave the index.md page blank (apart from front-matter) and add a comment , then the script here gets updated and the table of contents will get inserted at build-time.

I can do this in a follow up PR though :-)

Blargian · 2025-03-15T10:14:18Z

docs/use-cases/time-series/query-performance.md

+title: Query performance - Time-series
+sidebar_label: Query performance
+description: Improving time-series query performance
+slug: /use-cases/time-series/query-performance
+keywords: [time-series]


Suggested change

title: Query performance - Time-series

sidebar_label: Query performance

description: Improving time-series query performance

slug: /use-cases/time-series/query-performance

keywords: [time-series]

title: 'Query performance - Time-series'

sidebar_label: 'Query performance'

description: 'Improving time-series query performance'

slug: /use-cases/time-series/query-performance

keywords: ['time-series']

Blargian · 2025-03-15T10:43:07Z

docs/use-cases/time-series/basic-operations.md

+┌────────────────hour─┬─sum(hits)─┐
+│ 2015-07-01 00:00:00 │         3 │ <- missing values
+│ 2015-07-01 02:00:00 │         1 │ <- missing values
+│ 2015-07-01 04:00:00 │         1 │
+│ 2015-07-01 05:00:00 │         2 │
+│ 2015-07-01 06:00:00 │         1 │
+│ 2015-07-01 07:00:00 │         1 │
+│ 2015-07-01 08:00:00 │         3 │
+│ 2015-07-01 09:00:00 │         2 │ <- missing values
+│ 2015-07-01 12:00:00 │         2 │
+│ 2015-07-01 13:00:00 │         4 │
+│ 2015-07-01 14:00:00 │         2 │
+│ 2015-07-01 15:00:00 │         2 │
+│ 2015-07-01 16:00:00 │         2 │
+│ 2015-07-01 17:00:00 │         1 │
+│ 2015-07-01 18:00:00 │         5 │
+│ 2015-07-01 19:00:00 │         5 │
+│ 2015-07-01 20:00:00 │         4 │
+│ 2015-07-01 21:00:00 │         4 │
+│ 2015-07-01 22:00:00 │         2 │
+│ 2015-07-01 23:00:00 │         2 │
+└─────────────────────┴───────────┘


I get a slightly different result when I run this query:

Suggested change

┌────────────────hour─┬─sum(hits)─┐

│ 2015-07-01 00:00:00 │ 3 │ <- missing values

│ 2015-07-01 02:00:00 │ 1 │ <- missing values

│ 2015-07-01 04:00:00 │ 1 │

│ 2015-07-01 05:00:00 │ 2 │

│ 2015-07-01 06:00:00 │ 1 │

│ 2015-07-01 07:00:00 │ 1 │

│ 2015-07-01 08:00:00 │ 3 │

│ 2015-07-01 09:00:00 │ 2 │ <- missing values

│ 2015-07-01 12:00:00 │ 2 │

│ 2015-07-01 13:00:00 │ 4 │

│ 2015-07-01 14:00:00 │ 2 │

│ 2015-07-01 15:00:00 │ 2 │

│ 2015-07-01 16:00:00 │ 2 │

│ 2015-07-01 17:00:00 │ 1 │

│ 2015-07-01 18:00:00 │ 5 │

│ 2015-07-01 19:00:00 │ 5 │

│ 2015-07-01 20:00:00 │ 4 │

│ 2015-07-01 21:00:00 │ 4 │

│ 2015-07-01 22:00:00 │ 2 │

│ 2015-07-01 23:00:00 │ 2 │

└─────────────────────┴───────────┘

┌────────────────hour─┬─sum(hits)─┐

│ 2015-07-01 00:00:00 │ 4 │

│ 2015-07-01 01:00:00 │ 2 │ <- missing 02:00:00

│ 2015-07-01 03:00:00 │ 1 │ <- missing 04:00:00

│ 2015-07-01 05:00:00 │ 1 │

│ 2015-07-01 06:00:00 │ 2 │ <- missing 07:00:00

│ 2015-07-01 08:00:00 │ 1 │

│ 2015-07-01 09:00:00 │ 3 │

│ 2015-07-01 10:00:00 │ 2 │ <- missing 11:00:00, 12:00:00

│ 2015-07-01 13:00:00 │ 1 │

│ 2015-07-01 14:00:00 │ 4 │

│ 2015-07-01 15:00:00 │ 2 │

│ 2015-07-01 16:00:00 │ 2 │

│ 2015-07-01 17:00:00 │ 2 │

│ 2015-07-01 18:00:00 │ 1 │

│ 2015-07-01 19:00:00 │ 5 │

│ 2015-07-01 20:00:00 │ 5 │

│ 2015-07-01 21:00:00 │ 4 │

│ 2015-07-01 22:00:00 │ 4 │

│ 2015-07-01 23:00:00 │ 1 │

└─────────────────────┴───────────┘

Blargian · 2025-03-15T10:43:20Z

docs/use-cases/time-series/basic-operations.md

+┌────────────────hour─┬─sum(hits)─┐
+│ 2015-07-01 00:00:00 │         3 │
+│ 2015-07-01 01:00:00 │         0 │ <- new value
+│ 2015-07-01 02:00:00 │         1 │
+│ 2015-07-01 03:00:00 │         0 │ <- new value
+│ 2015-07-01 04:00:00 │         1 │
+│ 2015-07-01 05:00:00 │         2 │
+│ 2015-07-01 06:00:00 │         1 │
+│ 2015-07-01 07:00:00 │         1 │
+│ 2015-07-01 08:00:00 │         3 │
+│ 2015-07-01 09:00:00 │         2 │
+│ 2015-07-01 10:00:00 │         0 │ <- new value
+│ 2015-07-01 11:00:00 │         0 │ <- new value
+│ 2015-07-01 12:00:00 │         2 │
+│ 2015-07-01 13:00:00 │         4 │
+│ 2015-07-01 14:00:00 │         2 │
+│ 2015-07-01 15:00:00 │         2 │
+│ 2015-07-01 16:00:00 │         2 │
+│ 2015-07-01 17:00:00 │         1 │
+│ 2015-07-01 18:00:00 │         5 │
+│ 2015-07-01 19:00:00 │         5 │
+│ 2015-07-01 20:00:00 │         4 │
+│ 2015-07-01 21:00:00 │         4 │
+│ 2015-07-01 22:00:00 │         2 │
+│ 2015-07-01 23:00:00 │         2 │
+└─────────────────────┴───────────┘


Suggested change

┌────────────────hour─┬─sum(hits)─┐

│ 2015-07-01 00:00:00 │ 3 │

│ 2015-07-01 01:00:00 │ 0 │ <- new value

│ 2015-07-01 02:00:00 │ 1 │

│ 2015-07-01 03:00:00 │ 0 │ <- new value

│ 2015-07-01 04:00:00 │ 1 │

│ 2015-07-01 05:00:00 │ 2 │

│ 2015-07-01 06:00:00 │ 1 │

│ 2015-07-01 07:00:00 │ 1 │

│ 2015-07-01 08:00:00 │ 3 │

│ 2015-07-01 09:00:00 │ 2 │

│ 2015-07-01 10:00:00 │ 0 │ <- new value

│ 2015-07-01 11:00:00 │ 0 │ <- new value

│ 2015-07-01 12:00:00 │ 2 │

│ 2015-07-01 13:00:00 │ 4 │

│ 2015-07-01 14:00:00 │ 2 │

│ 2015-07-01 15:00:00 │ 2 │

│ 2015-07-01 16:00:00 │ 2 │

│ 2015-07-01 17:00:00 │ 1 │

│ 2015-07-01 18:00:00 │ 5 │

│ 2015-07-01 19:00:00 │ 5 │

│ 2015-07-01 20:00:00 │ 4 │

│ 2015-07-01 21:00:00 │ 4 │

│ 2015-07-01 22:00:00 │ 2 │

│ 2015-07-01 23:00:00 │ 2 │

└─────────────────────┴───────────┘

┌────────────────hour─┬─sum(hits)─┐

│ 2015-07-01 00:00:00 │ 4 │

│ 2015-07-01 01:00:00 │ 2 │

│ 2015-07-01 02:00:00 │ 0 │ <- filled value

│ 2015-07-01 03:00:00 │ 1 │

│ 2015-07-01 04:00:00 │ 0 │ <- filled value

│ 2015-07-01 05:00:00 │ 1 │

│ 2015-07-01 06:00:00 │ 2 │

│ 2015-07-01 07:00:00 │ 0 │ <- filled value

│ 2015-07-01 08:00:00 │ 1 │

│ 2015-07-01 09:00:00 │ 3 │

│ 2015-07-01 10:00:00 │ 2 │

│ 2015-07-01 11:00:00 │ 0 │ <- filled value

│ 2015-07-01 12:00:00 │ 0 │ <- filled value

│ 2015-07-01 13:00:00 │ 1 │

│ 2015-07-01 14:00:00 │ 4 │

│ 2015-07-01 15:00:00 │ 2 │

│ 2015-07-01 16:00:00 │ 2 │

│ 2015-07-01 17:00:00 │ 2 │

│ 2015-07-01 18:00:00 │ 1 │

│ 2015-07-01 19:00:00 │ 5 │

│ 2015-07-01 20:00:00 │ 5 │

│ 2015-07-01 21:00:00 │ 4 │

│ 2015-07-01 22:00:00 │ 4 │

│ 2015-07-01 23:00:00 │ 1 │

└─────────────────────┴───────────┘

Blargian · 2025-03-15T10:43:58Z

docs/use-cases/time-series/basic-operations.md

+
+## Filling empty groups {#time-series-filling-empty-groups}
+
+In a lot of cases we deal with sparse data with some absent intervals. This results in empty buckets. Let’s take the following example where we group data by 1-hour intervals. This will out the following stats with some hours missing values:


Suggested change

In a lot of cases we deal with sparse data with some absent intervals. This results in empty buckets. Let’s take the following example where we group data by 1-hour intervals. This will out the following stats with some hours missing values:

In a lot of cases we deal with sparse data with some absent intervals. This results in empty buckets. Let’s take the following example where we group data by 1-hour intervals. This will output the following stats with some hours missing values:

Blargian · 2025-03-15T10:44:07Z

docs/use-cases/time-series/basic-operations.md

+
+## Custom grouping intervals {#time-series-custom-grouping-intervals}
+
+We can even arbitrary intervals, e.g., 5 minutes using the [`toStartOfInterval()`](/docs/sql-reference/functions/date-time-functions#tostartofinterval) function. 


Suggested change

We can even arbitrary intervals, e.g., 5 minutes using the [`toStartOfInterval()`](/docs/sql-reference/functions/date-time-functions#tostartofinterval) function.

We can even group by arbitrary intervals, e.g., 5 minutes using the [`toStartOfInterval()`](/docs/sql-reference/functions/date-time-functions#tostartofinterval) function.

Blargian · 2025-03-15T10:44:14Z

docs/use-cases/time-series/basic-operations.md

+└────────────┴──────────┘
+```
+
+We’ve used the `toDate()` function here, which converts the specified time to a date type. Alternatively, we can batch by an hour and filter on the specific date:


Suggested change

We’ve used the `toDate()` function here, which converts the specified time to a date type. Alternatively, we can batch by an hour and filter on the specific date:

We’ve used the [`toDate()`](/sql-reference/functions/type-conversion-functions#todate) function here, which converts the specified time to a date type. Alternatively, we can batch by an hour and filter on the specific date:

Time series use case

135ad85

mneedham requested a review from a team as a code owner March 14, 2025 11:01

mneedham added 2 commits March 14, 2025 11:03

make the spell check happy

eba1435

make linter happy

7ab9856

vercel bot had a problem deploying to Preview – clickhouse-docs March 14, 2025 11:06 Failure

mneedham added 5 commits March 14, 2025 11:08

add intro

918138a

add works to exclude list

0f580b6

sub heading tags

9fac614

more heading ids

6ebe84d

link moved

c0b6607

vercel bot deployed to Preview – clickhouse-docs March 14, 2025 12:25 View deployment

mneedham requested a review from Blargian March 15, 2025 07:51

Blargian approved these changes Mar 15, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Time series use case #3502

Time series use case #3502

mneedham commented Mar 14, 2025

vercel bot commented Mar 14, 2025

vercel bot commented Mar 14, 2025 •

edited

Loading

Blargian left a comment

Blargian Mar 15, 2025

Blargian Mar 15, 2025

Blargian Mar 15, 2025

Blargian Mar 15, 2025

Blargian Mar 15, 2025

Blargian Mar 15, 2025

Blargian Mar 15, 2025

Blargian Mar 15, 2025

Blargian Mar 15, 2025

Blargian Mar 15, 2025

Blargian Mar 15, 2025


		## Filling empty groups {#time-series-filling-empty-groups}

		In a lot of cases we deal with sparse data with some absent intervals. This results in empty buckets. Let’s take the following example where we group data by 1-hour intervals. This will out the following stats with some hours missing values:


		## Custom grouping intervals {#time-series-custom-grouping-intervals}

		We can even arbitrary intervals, e.g., 5 minutes using the [`toStartOfInterval()`](/docs/sql-reference/functions/date-time-functions#tostartofinterval) function.

	We can even arbitrary intervals, e.g., 5 minutes using the [`toStartOfInterval()`](/docs/sql-reference/functions/date-time-functions#tostartofinterval) function.
	We can even group by arbitrary intervals, e.g., 5 minutes using the [`toStartOfInterval()`](/docs/sql-reference/functions/date-time-functions#tostartofinterval) function.

	We’ve used the `toDate()` function here, which converts the specified time to a date type. Alternatively, we can batch by an hour and filter on the specific date:
	We’ve used the [`toDate()`](/sql-reference/functions/type-conversion-functions#todate) function here, which converts the specified time to a date type. Alternatively, we can batch by an hour and filter on the specific date:

Time series use case #3502

Are you sure you want to change the base?

Time series use case #3502

Conversation

mneedham commented Mar 14, 2025

vercel bot commented Mar 14, 2025

vercel bot commented Mar 14, 2025 • edited Loading

Blargian left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

vercel bot commented Mar 14, 2025 •

edited

Loading