SHEll CURL获取DNS解析时间 TCP连接时间 http各阶段页面响应时间 http版本状态码信息
对于大型网站的优化来说,经常需要优化各项时间包括DNS解析时间,网站与访客建立TCP时间,网站整体打开时间等。这个时候可以用LINUX的CURL命令来获取。
curl命令查看请求响应时间
# curl -o /dev/null -s -w %{time_namelookup}::%{time_connect}::%{time_starttransfer}::%{time_total}::%{speed_download}" " https://www.bnxb.com
输出结果:
0.014::0.015::0.018::0.019::1516256.00
另外还可以
curl -o /dev/null -s -w "time_namelookup:%{time_namelookup}::time_connect:%{time_connect}::time_starttransfer:%{time_starttransfer}::time_total:%{time_total}::speed_download:%{speed_download}::http_code:%{http_code}" "https://www.bnxb.com"
输出类似
time_namelookup:0.127::time_connect:0.287::time_starttransfer:0.975::time_total:1.196::speed_download:38171.000::http_code:200
还可以加-I参数只输出header,不对整个网页进行下载,防止网页过大执行效率低,当然如果使用了这个参数,speed_download就没有数据了,会显示0
完整命令如下:
# curl -I -o /dev/null -s -w "time_namelookup:%{time_namelookup}::time_connect:%{time_connect}::time_starttransfer:%{time_starttransfer}::time_total:%{time_total}::speed_download:%{speed_download}::http_version:%{http_version}::http_code:%{http_code}" "https://www.bnxb.com"
当然还可以使用列表方式读取全部数据
cat url.txt|while read line; do curl -I $line -m 5 --connect-timeout 5 -o /dev/null -s -w "$line "%{http_code}" "; done>ok.txt
读取目录下url.txt中的网址数据,然后将结果输出到ok.txt中
命令详解
-o:把curl 返回的html、js 写到垃圾回收站[/dev/null]
-s:去掉所有状态
-w:按照后面的格式写出rt
time_namelookup:DNS 解析域名www.bnxb.com的时间
time_commect:client和server端建立TCP 连接的时间
time_starttransfer:从client发出请求;到web的server 响应第一个字节的时间
time_total:client发出请求;到web的server发送会所有的相应数据的时间
speed_download:下周速度 单位 byte/s
上面这条命令及返回结果可以这么理解:
0.014: DNS 服务器解析www.bnxb.com 的时间单位是s
0.015: client发出请求,到c/s 建立TCP 的时间;里面包括DNS解析的时间
0.018: client发出请求;到s响应发出第一个字节开始的时间;包括前面的2个时间
0.019: client发出请求;到s把响应的数据全部发送给client;并关闭connect的时间
1516256.00 :下载数据的速度
建立TCP连接到server返回client第一个字节的时间:0.018s – 0.015s = 0.003s
server把响应数据发送给client的时间:0.019s – 0.018 = 0.01s
下面附录一份完整的请求参数(有备注ADD版本的,就需要你自行升级服务器端的CURL才能支持,升级方法详见:https://www.bnxb.com/linuxserver/26916.html)
content_type 就是content-Type,不用多说了,这是一个访问我们网站返回的结果示例(text/html; charset=UTF-8);(The Content-Type of the requested document, if there was any.)
filename_effective The ultimate filename that curl writes out to. This is only meaningful if curl is told to write to a file with the -O, --remote-name or -o, --output option. It's most useful in combination with the -J, --remote-header-name option. (Added in 7.26.0)
ftp_entry_path The initial path curl ended up in when logging on to the remote FTP server. (Added in 7.15.4)
http_code http状态码,如200成功,301转向,404未找到,500服务器错误等。(The numerical response code that was found in the last retrieved HTTP(S) or FTP(s) transfer. In 7.18.2 the alias response_code was added to show the same info.)
http_connect The numerical code that was found in the last response (from a proxy) to a curl CONNECT request. (Added in 7.12.4)
http_version HTTP使用的版本,正常现在大部分是1.1,也有部分网站已经开启HTTP/2支持,这里显示的就是对方服务器支持的版本.The http version that was effectively used. (Added in 7.50.0)
local_ip The IP address of the local end of the most recently done connection - can be either IPv4 or IPv6 (Added in 7.29.0)
local_port The local port number of the most recently done connection (Added in 7.29.0)
num_connects Number of new connects made in the recent transfer. (Added in 7.12.3)
num_redirects Number of redirects that were followed in the request. (Added in 7.12.3)
proxy_ssl_verify_result The result of the HTTPS proxy's SSL peer certificate verification that was requested. 0 means the verification was successful. (Added in 7.52.0)
redirect_url When an HTTP request was made without -L, --location to follow redirects (or when --max-redir is met), this variable will show the actual URL a redirect would have gone to. (Added in 7.18.2)
remote_ip The remote IP address of the most recently done connection - can be either IPv4 or IPv6 (Added in 7.29.0)
remote_port The remote port number of the most recently done connection (Added in 7.29.0)
scheme The URL scheme (sometimes called protocol) that was effectively used (Added in 7.52.0)
size_download 下载大小。(The total amount of bytes that were downloaded.)
size_upload 上传大小。(The total amount of bytes that were uploaded.)
size_header 下载的header的大小(The total amount of bytes of the downloaded headers.)
size_request 请求的大小。(The total amount of bytes that were sent in the HTTP request.)
speed_download 下载速度,单位-字节每秒。(The average download speed that curl measured for the complete download. Bytes per second.)
speed_upload 上传速度,单位-字节每秒。(The average upload speed that curl measured for the complete upload. Bytes per second.)
ssl_verify_result ssl认证结果,返回0表示认证成功。The result of the SSL peer certificate verification that was requested. 0 means the verification was successful. (Added in 7.19.0)
time_total 总时间,按秒计。精确到小数点后三位。 (The total time, in seconds, that the full operation lasted. The time will be displayed with millisecond resolution.)
time_namelookup DNS解析时间,从请求开始到DNS解析完毕所用时间。(The time, in seconds, it took from the start until the name resolving was completed.)
time_connect 连接时间,从开始到建立TCP连接完成所用时间,包括前边DNS解析时间,如果需要单纯的得到连接时间,用这个time_connect时间减去前边time_namelookup时间。以下同理,不再赘述。(The time, in seconds, it took from the start until the TCP connect to the remote host (or proxy) was completed.)
time_appconnect 连接建立完成时间,如SSL/SSH等建立连接或者完成三次握手时间。(The time, in seconds, it took from the start until the SSL/SSH/etc connect/handshake to the remote host was completed. (Added in 7.19.0))
time_pretransfer 从开始到准备传输的时间。(The time, in seconds, it took from the start until the file transfer was just about to begin. This includes all pre-transfer commands and negotiations that are specific to the particular protocol(s) involved.)
time_redirect 重定向时间,包括到最后一次传输前的几次重定向的DNS解析,连接,预传输,传输时间。(The time, in seconds, it took for all redirection steps include name lookup, connect, pretransfer and transfer before the final transaction was started. time_redirect shows the complete execution time for multiple redirections. (Added in 7.12.3))
time_starttransfer 开始传输时间。在client发出请求之后,Web 服务器返回数据的第一个字节所用的时间(The time, in seconds, it took from the start until the first byte was just about to be transferred. This includes time_pretransfer and also the time the server needed to calculate the result.)
url_effective The URL that was fetched last. This is most meaningful if you've told curl to follow location: headers.
一份案例
curl -o /dev/null -s -w %{http_code}:%{http_connect}:%{content_type}:%{time_namelookup}:%{time_redirect}:%{time_pretransfer}:%{time_connect}:%{time_starttransfer}:%{time_total}:%{speed_download} www.bnxb.com
输出变量需要按照%{variable_name}的格式,如果需要输出%,double一下即可,即%%,同时, 是换行, 是回车, 是TAB。
-w 指定格式化文件
-o 请求重定向到,不带此参数则控制台输出返回结果
-s 静默,不显示进度
也可以定义时间格式化文件访问
#vim curl-time.txt
http: %{http_code}
dns: %{time_namelookup}s
redirect: %{time_redirect}s
time_connect: %{time_connect}s
time_appconnect: %{time_appconnect}s
time_pretransfer: %{time_pretransfer}s
time_starttransfer: %{time_starttransfer}s
size_download: %{size_download}bytes
speed_download: %{speed_download}B/s
----------
time_total: %{time_total}s
#curl -w "@curl_time.txt" -s -H "Content-Type: application/json" --insecure --header 'Host: passport.bnxb.com' --data '{"platform":"android","userimei":"F5D815EA2BD8DBARD","app_channel":"10000","mbimei":"9DB358AF","version":"3.1.4","username":"hqzx","userpass":"976af4"}' --compressed https://www.bnxb.com/user/login
curl以post请求方法
1)以json格式数据
#curl -H "Content-Type: application/json" -X POST --data '{"data":"1"}' http://127.0.0.1/
2)以&连接参数数据
#curl -d "data=7778a8143f111272&score=19&app_key=8d49f16fe034b98b&_test_user=test01" "http://127.0.0.1"
附带文本数据,比如通过"浏览"选择本地的card.txt并上传发送post请求,
其中-F 为带文件的形式发送post请求, blob为文本框中的name元素对应的属性值。<type="text" name="blob">
#curl -F "[email protected];type=text/plain" "http://172.16.102.208:8089/wiapi/score?leaderboard_id=7778a8143f111272&score=40&app_key=8d49f16fe034b98b&_test_user=test01"
安卓手机可以通过安装终端模拟器,然后在模拟器按以上方法使用curl调试定位app在移动数据网络环境下哪个环节出现慢的问题。
- 最新评论