快捷搜索:   服务器  PHP  安全  IIS  linux 安全

SHEll CURL获取DNS解析时间 TCP连接时间 http各阶段页面响应时间 http版本状态码信息

对于大型网站的优化来说,经常需要优化各项时间包括DNS解析时间,网站与访客建立TCP时间,网站整体打开时间等。这个时候可以用LINUX的CURL命令来获取。

curl命令查看请求响应时间

# curl -o /dev/null -s -w %{time_namelookup}::%{time_connect}::%{time_starttransfer}::%{time_total}::%{speed_download}" " https://www.bnxb.com

输出结果:

0.014::0.015::0.018::0.019::1516256.00


另外还可以

curl -o /dev/null -s -w "time_namelookup:%{time_namelookup}::time_connect:%{time_connect}::time_starttransfer:%{time_starttransfer}::time_total:%{time_total}::speed_download:%{speed_download}::http_code:%{http_code}" "https://www.bnxb.com"


输出类似

time_namelookup:0.127::time_connect:0.287::time_starttransfer:0.975::time_total:1.196::speed_download:38171.000::http_code:200


还可以加-I参数只输出header,不对整个网页进行下载,防止网页过大执行效率低,当然如果使用了这个参数,speed_download就没有数据了,会显示0

完整命令如下:

# curl -I -o /dev/null -s -w "time_namelookup:%{time_namelookup}::time_connect:%{time_connect}::time_starttransfer:%{time_starttransfer}::time_total:%{time_total}::speed_download:%{speed_download}::http_version:%{http_version}::http_code:%{http_code}" "https://www.bnxb.com"


当然还可以使用列表方式读取全部数据

cat url.txt|while read line; do curl -I $line -m 5 --connect-timeout 5 -o /dev/null -s -w "$line "%{http_code}"
"; done>ok.txt

读取目录下url.txt中的网址数据,然后将结果输出到ok.txt中


命令详解   

-o:把curl 返回的html、js 写到垃圾回收站[/dev/null]

-s:去掉所有状态

-w:按照后面的格式写出rt

time_namelookup:DNS 解析域名www.bnxb.com的时间

time_commect:client和server端建立TCP 连接的时间

time_starttransfer:从client发出请求;到web的server 响应第一个字节的时间

time_total:client发出请求;到web的server发送会所有的相应数据的时间

speed_download:下周速度 单位 byte/s

上面这条命令及返回结果可以这么理解:

0.014: DNS 服务器解析www.bnxb.com 的时间单位是s

0.015: client发出请求,到c/s 建立TCP 的时间;里面包括DNS解析的时间

0.018: client发出请求;到s响应发出第一个字节开始的时间;包括前面的2个时间

0.019: client发出请求;到s把响应的数据全部发送给client;并关闭connect的时间

1516256.00 :下载数据的速度

建立TCP连接到server返回client第一个字节的时间:0.018s – 0.015s = 0.003s

server把响应数据发送给client的时间:0.019s – 0.018 = 0.01s




下面附录一份完整的请求参数(有备注ADD版本的,就需要你自行升级服务器端的CURL才能支持,升级方法详见:https://www.bnxb.com/linuxserver/26916.html)

content_type 就是content-Type,不用多说了,这是一个访问我们网站返回的结果示例(text/html; charset=UTF-8);(The Content-Type of the requested document, if there was any.)

filename_effective The ultimate filename that curl writes out to. This is only meaningful if curl is told to write to a file with the -O, --remote-name or -o, --output option. It's most useful in combination with the -J, --remote-header-name option. (Added in 7.26.0)

ftp_entry_path The initial path curl ended up in when logging on to the remote FTP server. (Added in 7.15.4)


http_code http状态码,如200成功,301转向,404未找到,500服务器错误等。(The numerical response code that was found in the last retrieved HTTP(S) or FTP(s) transfer. In 7.18.2 the alias response_code was added to show the same info.)


http_connect The numerical code that was found in the last response (from a proxy) to a curl CONNECT request. (Added in 7.12.4)

http_version HTTP使用的版本,正常现在大部分是1.1,也有部分网站已经开启HTTP/2支持,这里显示的就是对方服务器支持的版本.The http version that was effectively used. (Added in 7.50.0)


local_ip The IP address of the local end of the most recently done connection - can be either IPv4 or IPv6 (Added in 7.29.0)

local_port The local port number of the most recently done connection (Added in 7.29.0)

num_connects Number of new connects made in the recent transfer. (Added in 7.12.3)

num_redirects Number of redirects that were followed in the request. (Added in 7.12.3)

proxy_ssl_verify_result The result of the HTTPS proxy's SSL peer certificate verification that was requested. 0 means the verification was successful. (Added in 7.52.0)

redirect_url When an HTTP request was made without -L, --location to follow redirects (or when --max-redir is met), this variable will show the actual URL a redirect would have gone to. (Added in 7.18.2)

remote_ip The remote IP address of the most recently done connection - can be either IPv4 or IPv6 (Added in 7.29.0)

remote_port The remote port number of the most recently done connection (Added in 7.29.0)

scheme The URL scheme (sometimes called protocol) that was effectively used (Added in 7.52.0)




size_download 下载大小。(The total amount of bytes that were downloaded.)


size_upload 上传大小。(The total amount of bytes that were uploaded.)


size_header  下载的header的大小(The total amount of bytes of the downloaded headers.)


size_request 请求的大小。(The total amount of bytes that were sent in the HTTP request.)


speed_download 下载速度,单位-字节每秒。(The average download speed that curl measured for the complete download. Bytes per second.)


speed_upload 上传速度,单位-字节每秒。(The average upload speed that curl measured for the complete upload. Bytes per second.)

ssl_verify_result ssl认证结果,返回0表示认证成功。The result of the SSL peer certificate verification that was requested. 0 means the verification was successful. (Added in 7.19.0)


time_total 总时间,按秒计。精确到小数点后三位。 (The total time, in seconds, that the full operation lasted. The time will be displayed with millisecond resolution.)


time_namelookup DNS解析时间,从请求开始到DNS解析完毕所用时间。(The time, in seconds, it took from the start until the name resolving was completed.)


time_connect 连接时间,从开始到建立TCP连接完成所用时间,包括前边DNS解析时间,如果需要单纯的得到连接时间,用这个time_connect时间减去前边time_namelookup时间。以下同理,不再赘述。(The time, in seconds, it took from the start until the TCP connect to the remote host (or proxy) was completed.)


time_appconnect 连接建立完成时间,如SSL/SSH等建立连接或者完成三次握手时间。(The time, in seconds, it took from the start until the SSL/SSH/etc connect/handshake to the remote host was completed. (Added in 7.19.0))


time_pretransfer 从开始到准备传输的时间。(The time, in seconds, it took from the start until the file transfer was just about to begin. This includes all pre-transfer commands and negotiations that are specific to the particular protocol(s) involved.)


time_redirect 重定向时间,包括到最后一次传输前的几次重定向的DNS解析,连接,预传输,传输时间。(The time, in seconds, it took for all redirection steps include name lookup, connect, pretransfer and transfer before the final transaction was started. time_redirect shows the complete execution time for multiple redirections. (Added in 7.12.3))


time_starttransfer 开始传输时间。在client发出请求之后,Web 服务器返回数据的第一个字节所用的时间(The time, in seconds, it took from the start until the first byte was just about to be transferred. This includes time_pretransfer and also the time the server needed to calculate the result.)


url_effective The URL that was fetched last. This is most meaningful if you've told curl to follow location: headers.



一份案例

curl -o /dev/null -s -w %{http_code}:%{http_connect}:%{content_type}:%{time_namelookup}:%{time_redirect}:%{time_pretransfer}:%{time_connect}:%{time_starttransfer}:%{time_total}:%{speed_download} www.bnxb.com

输出变量需要按照%{variable_name}的格式,如果需要输出%,double一下即可,即%%,同时, 是换行, 是回车, 是TAB。 

-w 指定格式化文件

-o 请求重定向到,不带此参数则控制台输出返回结果

-s 静默,不显示进度


也可以定义时间格式化文件访问

#vim  curl-time.txt

  

 

              http: %{http_code}  

               dns: %{time_namelookup}s  

          redirect: %{time_redirect}s  

      time_connect: %{time_connect}s  

   time_appconnect: %{time_appconnect}s  

  time_pretransfer: %{time_pretransfer}s  

time_starttransfer: %{time_starttransfer}s  

     size_download: %{size_download}bytes  

    speed_download: %{speed_download}B/s  

                  ----------  

        time_total: %{time_total}s  

 


#curl -w "@curl_time.txt"  -s  -H "Content-Type: application/json" --insecure --header 'Host: passport.bnxb.com' --data '{"platform":"android","userimei":"F5D815EA2BD8DBARD","app_channel":"10000","mbimei":"9DB358AF","version":"3.1.4","username":"hqzx","userpass":"976af4"}' --compressed https://www.bnxb.com/user/login

 

curl以post请求方法

1)以json格式数据


#curl -H "Content-Type: application/json" -X POST  --data '{"data":"1"}'  http://127.0.0.1/  

2)以&连接参数数据



#curl -d "data=7778a8143f111272&score=19&app_key=8d49f16fe034b98b&_test_user=test01" "http://127.0.0.1"  


附带文本数据,比如通过"浏览"选择本地的card.txt并上传发送post请求,

其中-F 为带文件的形式发送post请求,   blob为文本框中的name元素对应的属性值。<type="text" name="blob">


#curl  -F "blob=@card.txt;type=text/plain"  "http://172.16.102.208:8089/wiapi/score?leaderboard_id=7778a8143f111272&score=40&app_key=8d49f16fe034b98b&_test_user=test01"   

安卓手机可以通过安装终端模拟器,然后在模拟器按以上方法使用curl调试定位app在移动数据网络环境下哪个环节出现慢的问题。


顶(0)
踩(0)

您可能还会对下面的文章感兴趣:

最新评论