演讲的主题是性能优化,但不是真正的性能优化,而是性能优化的缺点(在VictoriaMetrics中)。
视频
稍后再告诉您。首先,我会告诉您一些关于我自己的事。
- 我是Alexander Valyalkin。我的昵称是valyala。
- 我是Go库的作者,例如Fasthttp,Fastjson,Quicktemplate。这些库针对速度进行了优化。
- .
- timeseries VictoriaMetrics.
? , :
- .
- hardware , , .
- – benchmark games. , benchmarks. production.
, . . , .
Fasthttp, fastjson, VictoriaMetrics. Go . Go. .
Fasthttp. Fasthttp – net/http, , .
Fasthttp , :
- .
- HTTP headers.
- slices maps
key->value
. -
requestCtx
. - DNS .
c . HTTP Go. .
. http . , . , . , . , . . keep-alive, .
? , , / , . . .
, . , HTTP pipelining .
HTTP pipelining – HTTP , .
. . bufio.NewReader bufio.NewWriter. . : , , Write .
, . , , .
pipelining connection. ? – - , . , , , .
? , , . 4 . . . , bufio.Reader
, reader 4- .
4 , . , .
. 4 , . , , «flush». . , . .
https://en.wikipedia.org/wiki/HTTP_pipelining#Implementation_status
https://github.com/TechEmpower/FrameworkBenchmarks/issues/4410
.
, HTTP pipelining head of line blocking. - , , HTTP connection , , . , .
. HTTP pipelining . , , HTTP pipelining, . ? HTTP, 2000- , HTTP pipelining, HTTP pipelining. , HTTP pipelining. HTTP 2.0 . , HTTP pipelineing, HTTP 2.0.
HTTP pipelining – , , Techempower benchmarks . Techempower benchmark – , HTTP . , plaintext. 16 pipelining requests . HTTP pipelining fasthttp
2 .
. . , , , .
– HTTP headers.
Fasthttp HTTP headers . HTTP headers. . headers byte slice . byte slice HTTP headers.
Fasthttp, HTTP header . : «Hello, world!» http http headers.
, http headers. , header «X-Forwarded-For», Fasthttp HTTP header.
? , HTTP , HTTP headers .
– , http . , , . .
slices maps. Fasthttp slices key->value
go’ map' , , . . , query args, cookies.
, . key->value
byte slices.
slice map.
? , slice map – byte slice. kvs – byte slice . capacity , , , . . . slice, . . -. — [:0]
, , , kv.value, - .
slice map, kv.value byte slice slice map. , , .
slice map. slice map’ . , . .
? , slice maps, , query args cookies, — . slice maps , map Go.
, , slice maps maps. . . slice maps .
, — , . . . query args , slice map , map, map.
. query args , , , slice map – O(N)
, . . , slice. , slice map, .
— , slice map . , slice map - , , , slice map , .
— , , slice map, slice map. , slice map . .
– RequestCtx
. RequestCtx
– , http.ResponseWriter
http.Request
. , RequestHandler
. HTTP .
. . RequestCtx. . ctx.Request
. RequestHandler
RequestCtx
response connection. . . . RequestHandler
RequestCtx
, , , RequestHandler
.
? , RequestCtx
. , , . .
, , . API . , - RequestCtx
RequestHandler
- , , . RequestHandler
. , Fasthttp, . . RequestCtx
, , , .
, — . RequestCtx
- request response body, - . RequestCtx
, . .
– DNS. Fasthttp . resolve DNS . Fasthttp DNS , . . resolving. Fasthttp mapping name ip .
, . resolveHost. dnsCache map’a. . , , . , locks. , . , .
? DNS resolving.
– , HTTP , DNS . – Kubernetes, pods, IP-. , , Fasthttp , pod’ . , .
Fasthttp . Fastjson .
Fastjson – encoding/json. , . , .
"" fastjson:
.
.
integers floats.
. Fastjson Parser, JSON. , , .
. Parser.Parse. value. value . . . value Parser
. foo
. b
. b
.
JSON. v
b
, , v
p
, . . . vv
, , .
? , JSON.
– , API . , , , JSON’, .
– , , . . . JSON , , , , 1 , JSON, , 2 , . . . 2 .
– unescaping . Fastjson . escape . escape , . . escape , , .
, , escape , . strings.IndexByte — go’ . .
– , escape .
– , , escape , — , , , . .
– floats integer Fastjson.
, , strconv.
? : « strconv
?». , . . edge cases. . . , strconv
. , , , strconv
.
– , 0, .
– , - , .
. VictoriaMetrics Prometheus remote write API . protobufs.
protobuf , Prometheus. , , . .
. protobuf. timeseries, labels samples. label name value. Sample, , timestamp.
. labels name string. byte slice. , , , name. byte slice data string. , . . string . , , . .
. slice labels, . . slice labels. . label , label , label. capacity , , .
, . , , protobuf.
, . , string byte slice, byte slice , name. byte slice, protobuf, , , name , .
. – .
– sync.Pool.
. strconv.FormatInt Go . Int, nSmalls, 99 100. base ( , ) 10. small
, .
? , , 100, .
, , , . . . , , , .
sync.Pool
— .
— . , sync.Pool
byte slice, byte slice'.
— CPUs. (pipeline). pipeline , , , . , . . pipeline .
. , — . , , Meltdown Spectre, - .
. . , — ? API. . ..
Fasthttp , . . . benchmarks. ? - 10 %, . . 10 % 200 %?
. . , 10 %, . Fasthttp , TechEmpower benchmarks. c Fasthttp, net/http
.
电报聊天:https : //t.me/VictoriaMetrics_ru1