CVS log for parser3/src/main/pa_http.C

Up to [parser3project] / parser3 / src / main

Request diff between arbitrary revisions - Display revisions graphically

Keyword substitution: kv
Default branch: MAIN

Copyright year updated, websites links changed to https://

old gcc compilation fix (related to feature #1277)

implements feature #1277
String::Body(const char *abody) now explicit
but HashString::put(const char *str, V value) added for simplicity
optimizations:
HASH_PUT_CSTR used where hash.put called several time during execution;
caching String::Body::uitoa used at all pash.put(<uint> calls.

final fixes for --with-build-warnings (dangling-reference warnings can be ignored)

more fixes for --with-build-warnings

pa_send added to handle partial writes (fixes bug #1261)

Copyright year updated

format replaced with pa_uitoa where applicable, $.date[unix-timestamp] fixed for handling large dates

minor error messages spelling fixes

optimization: Value::as() removed as dynamic_cast is faster, Value::is() is still required for is operator.

Array::Iterator unified with Hash::Iterator, has_next() replaced with operator bool (related to feature #930)

Array class extended, Array::Iterator added and used (related to feature #930)

Testing shows that TCP_NODELAY has no positive performance effect in our case

cookies without value are now parsed correctly (fixed bug #1238)

copyright, authors actualized

MSVC SOCKET warnings war

pa_strncpy added ans used to avoid strncpy drawbacks

no alarm() in file::load when web server mode is MULTITHREADED

@conf[] +CLASS-GETTER-PROTECTED, +LOCALS. $main -> $MAIN in exception texts (implements feature #1207)

*** empty log message ***

+valid_http_method

SERVER_PORT now available

no HAVE_TLS -> no multithreads mode

content logging added

HTTPD_DEBUG added for logging network exchange

we need to ignore "void" connections from browsers
(browsers open connections in advance and they will be empty if user does not request more pages)

Copyright year updated

$main:HTTPD.mode implemented

no ALARM in MULTITHREADED httpd server mode

initial support for MULTITHREADED and PARALLEL httpd server modes

msvc warnings war

windows warning war

pa_recv added with timeout support, thus read copied in httpd.

*** empty log message ***

ALARM code unified to be used in httpd

URI validation added

*** empty log message ***

*** empty log message ***

url no longer needed as ALTER_EXCEPTION_SOURCE is used

check_file_size filespec is now optional

ALTER_EXCEPTION_SOURCE and ALTER_EXCEPTION_COMMENT added for better error reporting

pa_atoi / pa_atoui / pa_atoul usage checked. 10 is now default base, no hex autodetect by default

connection socket closing in destructor + accept exception handling

global try exception handling unified

*** empty log message ***

warning war

warning war

http_read_response moved to HTTP_response class

read_post implemented

[host:]port syntax support in httpd mode

ResponseHeaders -> HTTP_Headers

initial httpd mode implementation

renamed

base64 options used

base64 options added, but not yet implemented (related to feature #986)

fixed spelling typos from lintian reported by Sergey B Kirpichev (fixes bug #1156)

Copyright year: 2015->2017

check_file_size added and used in curl / file load from disk and http, http file load rewritten (related to bug #1014)

charsets -> pa_charsets, vs2015 warning war

cleanup: string::split limit argument removed as no longer required, pos_after no longer reference (related to feature #11)

typo bugfix for clang compiler (related to feature #1042)

charsets.get now does str_upper inside (related to feature #1061)

whitespace optimizaion

^curl:load[] now support multiple headers, ^file::load supports headers transcoding (implements feature #1042)

get_uuid_boundary() added and used, static boundary in mail removed, Errors-To: mail header removed (implements feature #1047)

minor cleanup

Copyright year updated

checkBOM detects charset if it's not enforced, skips BOM signature if it complies charset (fixes bug #1037)

Now char * is converted to CORD only using AS_CORD() to check for empty cord bug (fixes bug #957)

idna_host added, related to issue #849

set_addr corrected, pa_idna_encode call added (related to issue #849)

new(UseGC) replaced with new, malloc/strdup/free replaced with pa_ version and checks for accidental use of non-pa_ version added (related to issue #1018)

C++11 compilation errors fixed (related to ticket #958)

$request:headers, $request:method added (implements feature #1007)

response-charset option should finally work now (fix for issue #867)

response-charset option should work now (fix for issue #867)

headers cleanup

response-charset option added to file::load (closes issue #867)

no message

- parsing cookies is moved to a separate method

GPF on ^cookies:save fixed, $file.cookies now creates correct table (fixes issue #910)

- ^file:load[...;http://...] - all received cookies are parced and stored into $.cookies ( new feature: #31 )

ident now works under Linux + ident displays filenames (closes issue #818)
Copyright updated

- use pa_isalpha and pa_isalnum instead of isalpha and isalnum
- bug with redundand quoting lowercased latin chars while building email body was fixed

pa_http_safe_header_name corrected a bit

L_HTTP_HEADER now used in http headers values, pa_http_safe_header_name added for headers names (fixes bug #195)

":port" is now added to "Host:" header if port is not default (fixes issue #155);
exception on invalid port added.

files upload now uses binary blocks instead of L_FILE_POST tainting. (bugfix: #128)

- transcode file from utf-8 to $request:charset during loading if the BOM code is detected ( new feature: #98 )

- exception comment strings "options must be hash", "options must be hash, not code" and "called with invalid option" were replaced by constatns
- exception comment string "invalid option passed" was replaced by "called with invalid option" (now in different methods are the same exception comment string)

- little optimisation

- little hacking: for dealing with transcoding+^taint[uri] transcode_and_untaint was replaced by untaint_and_transcode

no message

- bugfix: the values of http headers didn't ^tainted[uri] so it was possible to make request with incorrect http header

- capitalization of http headers during file::load[http was slightly changes
- bugfix: all headers which parser sends during file::load[http should be transcoded and only then escaped

no message

- capitalization of http headers during file::load[http was implemented

- back to storing response http headers in lowercase
- capitalize them during output

- http headers were changed: content-type => Content-type and so on

no message

- ^file::load[http://...;$.body[]] : $.body transcoded, but tainted pieces are escaped only when content-type==url-encoding

- some fixes with transcode+untaint

- new classes implementation

- bugfix: error was during detecting content-type of file which was loaded by http

- bugfix: $.cookies' values should be force tainted in ^file::load[http://...;$.cookies[]]

- some code cleanup

- cstr(params) and cstrm(params) were deleted. taint_cstr[m] and untaint_cstr[m] should be used

- file::load[http works now with uploading files _and_ changing $.charset

- bugfix: content-length was not calculated if $.body was specified

- one method detect_charset was deleted
- bug was fixed in this method (error while detecting charset in content_type withot last ';')

- String constructors don't have that stupid true/false param which means 'tainted'. they accept lang instead.

- bugfix: double CRLF before the end of boundary

no message

- ^file::load[...;http://...;] now can post files (new option $.encode[multipart-form/data] should be specified)
- $.method[] option for file::load now is not case-sensitive

- value of $.method[] option force uppercased now

- some constants changed their names

- some formating changes

- some exceptions while operations with files not typeless anymore

- escape $cookies as %uXXXX while file::load[...;http://

- skip BOM code before transcode
- escape method has new option for skip converting '+' to a space char

- option for disable transcoding while file_read and file_read_text added

- some polish

- detect_charset moved out of here

- new constants used
- don't allow $.content-type in ^file::load[;http://;$.method[POST]]
- add charset info while ^file::load[;http://;$.method[POST]]
- option $.omit-post-charset(true) added to ^file::load[;http://] for disabling charset during post

- exception if $.body[] and $.forms[] specified together in file::load[;http]
- get back transcoding $.body[] in file::load[;http]

- transcode $.headers before escaping into specified charset while ^file::load[...;http://...] (L_URI instead of L_HTTP_HEADER)
- $.cookies param available in ^file::load[;http://...] now (but we don't parse set-cookies from response yet) (cookies not transcoded as common $cookies)

- taint names of $.headers for load[;http

- some outdated comments removed

- "parser.runtime" strings were removed

- $.charset option for ^file::load[text;/local.txt] and ^table::load[/table.txt] was added
- not needed transcodes were removed from ^file::load[...;http://...]

- bug fix. now tainted data from $.form and query converted to $.charset during ^file::load[http://...]

- second param for this mid method is length but not end_index so this method has error and can't detect charsets in next content-types:
Content-type: text/html; charset="windows-1251"
Content-type: text/html; charset="windows-1251";
Content-type: text/html; charset=windows-1251;

only
Content-type: text/html; charset=windows-1251
was fine

+ ^break[] ^continue[], in ^for, ^while, ^menu, ^hash/hashfile.foreach

! switched to VS2005 (projects and object<info explicitly typed>.for_each(, info))
+ $response:field[] setting void means removing
+ grammar $name` name stops now, for mysql `$field`
+ started ^break[] ^continue[], in ^for. TODO: to other iterators (while, menu, foreach)
+ all log messages += [uri=, method=, cl=]

merged from HEAD:
! status line check made earlier [was totally wrong]

! status line check made earlier [was totally wrong]

merged from HEAD:
+! ^file::exec/cgi[script;$.charset[changed] $.QUERY_STRING[^untaint[URI]{aaa=$form:text} << now %HH would be encoded in $.charset charset

. extracted http:// into separate file [preparation for ^file::cgi[script;$.form[$.field1[]