Professional Documents
Culture Documents
Pino T: Kishore Gopalakrishna
Pino T: Kishore Gopalakrishna
Kishoret
Gopalakrishna
Columnar
SQL-like Real-time
storage and
data
indexing
interface load
• Mutation
Broker Helix
Pinot
Real
Historical Architecture
time
Broker
s
Helix S3
S1 S2
S3 S1 S2
Server
Tuesday, August 18, 15 s
Pinot Query Execution:
Distributed
1.Query
Brokers
Helix
S1 S2 S3
S3 S1 S2
Server
Tuesday, August 18, 15 s
Pinot Query Execution:
Distributed
1.Query
Helix
S1 S2 S3
S3 S1 S2
Server
Tuesday, August 18, 15 s
Pinot Query Execution:
Distributed
1.Query
S3 S1 S2
Server
Tuesday, August 18, 15 s
Pinot Query Execution:
Distributed
1.Query
EXECUTION ENGINE
INVERTED BITMAP
INDEX INDEX
COLUMN FORMAT
SELECT
Aggregation
campaignId, Group by campaignId,Click
sum(clicks) Operator tuple
FROM Table A Projection
Matching
Operator
WHERE doc ids
accountId = 121011 Pinot
Filter
AND
'day' > = 15949
Operato
r Segments
GROUP BY Da ta
campaignId sources
campaign Id click account Id day
Servers
• Brokers and Servers register themselves in Helix
• All servers start with no use case specific
configuration
Tuesday, August 18, 15
On boarding new use
case
XLNT
Tag XLNT Controller Broker
TableName XLNT_T1 s
Servers 3 Helix
Brokers 1
Create Table
XLNT XLNT XLNT
command
Servers
Controller Broker
Helix s
S2
Upload S1 S2 S3
S3 Segment
TableName XLNT_T1
Copies 2
S3 S1 S2
Server
s
Smart pre-
N/A star-tree Allows trade off between latency and space
materialization
30
Tuesday, August 18, 15