CVS log for parser3/src/classes/file.C

Up to [parser3project] / parser3 / src / classes

Request diff between arbitrary revisions - Display revisions graphically

Keyword substitution: kv
Default branch: MAIN

Copyright year updated, websites links changed to https://

Optimization: valid_options optimized where HashStringValue::Iterator used

^file.save $.append(false|true) option added (implements feature #1284)

implements feature #1277
String::Body(const char *abody) now explicit
but HashString::put(const char *str, V value) added for simplicity
optimizations:
HASH_PUT_CSTR used where hash.put called several time during execution;
caching String::Body::uitoa used at all pash.put(<uint> calls.

more fixes for --with-build-warnings

FIRST_ARG_MUST_NOT_BE_CODE replace with better messages (related to feature #1267)

MODE_MUST_NOT_BE_CODE -> MODE_MUST_BE_STRING (related to feature #1267)

some file methods now accept file as path specification (adopted Sumo patch implements feature #1265)

params.as_file_name(N) added and used instead of params.as_string(1, FILE_NAME_MUST_BE_STRING) where appropriate (implements feature #1121)

filename is everywhere params.as_string, unify exception and remove FILE_NAME_MUST_NOT_BE_CODE (related to feature #1121)

minor optimization

typo fixed

singletones used to reduce memory allocation befor main(). Only 3 allocations in chatsets left (implements feature #1257)

remove trailing empty arguments for backward compatibility (related to feature #1252)

Copyright year updated

spelling

^file::exec[cmd;;$array] supported (implements feature #1252)
bugfix: empty arguments no longer skipped

format replaced with pa_uitoa where applicable, $.date[unix-timestamp] fixed for handling large dates

minor error messages spelling fixes

rows number now checked in ^file::sql{}

optimization: Value::as() removed as dynamic_cast is faster, Value::is() is still required for is operator.

faster templated pa_itoa/pa_uitoa added to work with any integer type, String::Body::Format removed

bugfix: crc32 should not be negative (under Apple M1 when negative double converts to uint the result is 0) and crc32 should be 32 bits

copyright, authors actualized

hash no longer is accepted as file parameter (fixes bug #1218)

Copyright year updated

r.absolute -> r.full_disk_path

pa_base64_encode(file) removed - more memory, but faster and less code (related fo feature #986)

optimization: offset and limit options parsing moved inside file_load.

optimization: file_read replaced with simplified file_read_binary

*** empty log message ***

optimization: void pa_base64_decode -> size_t pa_base64_decode (related to feature #986)

more correct arguments separation

base64 options added, but not yet implemented (related to feature #986)

Show query instead of connect string in query_event_handlers exceptions (implements feature #1196)

^file:copy[..; $.append(bool) ] option added from misha@ patch (implements feature #919)

fixed spelling typos from lintian reported by Sergey B Kirpichev (fixes bug #1156)

Copyright year: 2015->2017

wchar filenames API under Windows now used (implements feature #1081)

stat -> pa_stat (related to feature #1014)

VS2003 warning war

file_stat now return 64-bit size (implements #1014 under 32-bit unix versions)

load should not return file with null body (fixes bug #1119)

pa_exec now supports $.stdin[$binary_file] (fixes bug #1044)

cleanup: r.write_pass_lang, r.write_no_lang -> r.write (implements feature #1091)

Temp_lang removed, write_no_lang now almost equal write_pass_lang (related to feature #1091)

optimization: write_assign_lang removed as not required (first part of feature #1091 implementation)

proces_to_value -> process after StringOrValue removed (related to feature #1020)

charsets -> pa_charsets, vs2015 warning war

vs2015 warning war

cleanup: string::split limit argument removed as no longer required, pos_after no longer reference (related to feature #11)

minor bugfix: is_text should be taked from fcontent.is_text_mode() if not set (related to feature #1061)

aset_text_mode argument optimized

checkBOM now used in detect_binary_content (related to feature #1061)

^file::create now supports $.from-charset[] and $.to-charset options (implements feature #1061),
automatic transcode is done if text file is created from binary file and charset is detected.

charsets.get now does str_upper inside (related to feature #1061)

pa_common.h: File_read_action: fname, as_text arguments removed;
image.C - absolute path shown in exception (implements feature #1071)

optimizaion: *_base_class removed (related to feature #1051)

Copyright year updated

explicit String::Body(char) calls removed; String::Body(String::C) constructor added (related to bug #957)

minor optimization

Now char * is converted to CORD only using AS_CORD() to check for empty cord bug (fixes bug #957)

warning war

directories are now correctly determined if _d_type == DT_UNKNOWN (closes bug #1027)

warning war (-pedantic flag)

removed most of the clang compiler warnings (closes issue #1018)

$request:headers, $request:method added (implements feature #1007)

- warnings war

"PARSER_VERSION" -> PARSER_VERSION ( bugfix: #12 )

bugfix for http://www.parser.ru/forum/?id=79337

cstr_to_string_body_untaint should be called with charsets for possible uri language and connection for possible sql language.
related to issue #857

^file:list[path][$.filter[regexp] $.stat(true)] usage commented

^file:list[] now has dir column and when $.stat(true) it has size/*date columns
modified patch from misha@ that closes issue #914.

default content-type for text/binary files without name added;
^file::create[$f;...] options now works properly and $f properties are default (fixes issue #928)

- ^file:delete[] now supports an option $.exception(false) that suppress any exception while deleting file ( new feature: #916 )

^file:delete and ^file:move now support option $.keep-empty-dirs(true) ( new feature: #884 )

no message

feols_normalized -> fis_text_content
set_binary added

- ^file::create[text;content] EOLs in content now is normalized. ( new feature: #815 )

- MethodParams::as_hash is optimized and improved (whitespaces are allowed as empty options)
- MethodParams::as_table is added
- above methods are used for parsing methods' options ( new feature: #9 )

- use strrpbrk & rskipchars instead of lastposafter
- ^file:dirname[] & Co proper handle windows file paths ( bug fix: #783 )
- ^file:dirname[] & ^file:basename[] now work as *nix commands

ident now works under Linux + ident displays filenames (closes issue #818)
Copyright updated

- $.strict(true|false) option is added to base64 decode methods ( new feature: #55 )

- PARSER_VaRSION => PARSER_VeRSION

- constructor ^file::create[mode;filename;content[;options]] now accepts binary mode and file-content
- new constructor's format: ^file::create[string-or-file-content[;$.name[filename] $.mode[text|binary] $.content-type[...] $.charset[...]]] ( new feature: #65 )

- params.as_hash is used more while parsing methods hash-options

new feature: $.stdin now untainted

used_directly() now true by default

- $.content-type option now can be specified in ^file::create ( new feature: #102 )

- typo in file:sql exception was fixed

- now ^file::base64 accepts up to 4 params (similar to others file's methods): ^file::base64[mode;user-file-name;encoded;options] ( new feature: #68 )

- set PARSER_VARSION env before external script executing

- exception comment strings "options must be hash", "options must be hash, not code" and "called with invalid option" were replaced by constatns
- exception comment string "invalid option passed" was replaced by "called with invalid option" (now in different methods are the same exception comment string)

- method lastposafter is moved to pa_common.h

fixes #48 Now not throw "not save environment variable" exception in grpunlim version.

- curl class was added

- file::create now accepts 4th param: options with $.charset

- types where changes (minus 2 warnings)

- file_write accepts Request_charsets and asked charset and cound transcode content before writing
- string.save and file.save have option $.charset now

- http headers were changed: content-type => Content-type and so on

- new classes implementation

no message

- some code cleanup

- cstr(params) and cstrm(params) were deleted. taint_cstr[m] and untaint_cstr[m] should be used

- optimizations and simplification of string.cstr(...)

- file objects now could have mode field (text|binary)

- create object for storing object's fields only for parser objects

- bugfix: file::exec didn't work after optimizing of helper_length

- bugfix: ^file:list[path;] [empty second param) should work

- String constructors don't have that stupid true/false param which means 'tainted'. they accept lang instead.

no message

- result optimisation
- helper_length parameter removed from string constructors

- little optimisation: somewhere length() was replaced by is_empty()

no message

- use vregex object instead of direct calls methods from pcre lib

- use vregex object instead of direct calls methods from pcre lib

- more changes for parsing different number of params for file::load

- ^file::load[...;http://...;] now can post files (new option $.encode[multipart-form/data] should be specified)
- $.method[] option for file::load now is not case-sensitive

- some constants changed their names

- fixed 4-th paramether for file::load
- little code rewriting

- some exceptions while operations with files not typeless anymore

- exception while pce operations not typeless anymore

- bugfix: ^taint[regex][] didn't works in file:list

- use method for print pcre_exec text error

- moved to new PCRE library and set flag UTF8 if $request:charset is UTF-8

- pcre now everywhere in separate namespace

- allow $.limit for file::sql as well

- allow $.offset option for file::sql
- force send limit=1 to query for use sql specifics authomatically

- $.limit(0) fixes

no message

- bugfix: double absolute path while loading file

- stat file while loading (local only) so .adate, .mdate and .cdate available without additional ::stat

- $.name and $.content-type available for stated file

- fixes in code formatting and comments

- bugfix: core while processing headers if executed cgi script don't return content

- .body must be set before analyzing cgi headers

- bugfix: we must transcode output fix EOLs only if exec/cgi return anything.

- ^file:exec[[text|binary];script;...]

- more text strings moved to the one place

- more duplicated exception text strings were removed

- some duplicate exceptions' text strings removed

- cosmetic changes

- comment removed

- "parser.runtime" strings were removed

- little optimization for getting args in exec/cgi

- arguments for file::exec/cgi can be specified now as s table with one column

- under lock we create non-exist dir anyway

- some similar strings moved to #define instead of to be copy/pasted many times

- ^file:base64[filespec]

- file_block_read used instead of native read

no message

- ^file:copy[from;fo] was added

- ^file.md5[] and ^file:md5[file-name] were added

- some comments were changed
- added ^file:crc32[file-name] and ^file.crc32[]

- empty args in file::exec removed now

proper tainting of ^file::exec/cgi[script;env;COMMAND;LINE;PARAMS]

+ ^break[] ^continue[], in ^for, ^while, ^menu, ^hash/hashfile.foreach

! switched to VS2005 (projects and object<info explicitly typed>.for_each(, info))
+ $response:field[] setting void means removing
+ grammar $name` name stops now, for mysql `$field`
+ started ^break[] ^continue[], in ^for. TODO: to other iterators (while, menu, foreach)
+ all log messages += [uri=, method=, cl=]

merged from HEAD:
! changed file/dir_readable to simple file/dir_exist, this would help in situations "class not found because .p file has bad rights" << in that case error would be explicit "access denied to 'this' file"

! changed file/dir_readable to simple file/dir_exist, this would help in situations "class not found because .p file has bad rights" << in that case error would be explicit "access denied to 'this' file"

merged from HEAD:
+! ^file::exec/cgi[script;$.charset[changed] $.QUERY_STRING[^untaint[URI]{aaa=$form:text} << now %HH would be encoded in $.charset charset

+! ^file::exec/cgi[script;$.charset[changed] $.QUERY_STRING[^untaint[URI]{aaa=$form:text} << now %HH would be encoded in $.charset charset

merged from HEAD:
+ ^file.base64[] encode
+ ^file::base64[encoded] decode

+ ^file.base64[] encode
+ ^file::base64[encoded] decode

+ ^string.base64[] encode
+ ^string:base64[encoded] decode

+ merged from HEAD: ^file::create[text;file.xml;^untaint[xml]{data}]

+ ^file::create[text;file.xml;^untaint[xml]{data}]

merged to HEAD:
! table::save with enclosers now doubles them: "->""
! table::save/load do not remove elements from options hash

! table::save with enclosers now doubles them: "->""
! table::save/load do not remove elements from options hash

2005

merged +file::cgi/exec now params: 50 max (were 10)

+ file::cgi/exec now params: 50 max (were 10)

. 2005 ;)

+ 3.2.0 beta: merged from dynamic_fields_join

joined_dynamic_fields: started

! string invariant violated in passing empty strings to file::exec/cgi environment

! bugfix ^file::load[mode;name;$.offset $.limit] now work again [support was broken in 3.1.4]

change: ^file::sql{query}[[options]]
options:
$.name[file name]
$.content-type[application/what]

bugfix: file::cgi headers were lost [typo error from 3.0.8 version]

bugfix: $f[^file::load[;http://]] $f.content-type now = that of http response

bugfix: $f[^file::load[;http://]] $f.content-type now = that of http response

moving file:send somewhere else..

patched:  ^file:send by Victor Fedoseev <vvf_ru@mail.ru>
todo: turn it to $response:download[
$.filename[filename]
$.option[]
,,
]

beauty: invalid mode thoroughly reported

bufix: on unix AND win32 environment string now untainted according to their languages.
were: as-is. EVERYWHERE

started:
	^void:sql{call paf(:a)}[
		$.bind[
			$.a[2]
		]
	]
input variables work.
todo:output

new: ^file::sql[[name_to_become_$.name]]{}
query result must be one row with columns:
  first: data
  second: file name
  third: content-type

^file.sql-string[] inside ^connect gets properly escaped string, which can be passed to request
now this for mysql only. it's up to parser sql driver to fix zeros properly

2004

beauty cancel: gcc does not understand that

beauty: removed redundant ctor call [relying on implicit String::Body(cstr) call]

more warnings --

more warnings --

static const char * const IDENT

turned on warnings level4 on all projects (except libltdl=off & libsdbm=level3)
found several unitialized vars

resurrected: pool idea. now only for destructing objects at request processing end

string_fragments_to_cord merged to HEAD

v() functions of String::Body, String::Languages and String itself
StringBody->String::Body

moved tempate_gc to HEAD

comment on OS

file::exec/cgi environment variables now must be UPPERCASE and A-Z 0-9 _-

env passing fixed

merged from HEAD file::exec/cgi .charset

fixed several uninitialized local structures.
notably ^hash.foreach now inserts delimiters properly [were inserting it before first body]

initialized request_info properly

few forgotten <0 changed to !=STRING_NOT_FOUND

small bug introduced in autoptr times fixed

^file::load[mode;name;
    $.offset
    $.limit

started http://
  $.charset[] param
and
  http response charset detection
just compiled.
todo:test

pa_vform violated String::invariant. started fixing [not compiled now]

incorportated pa_exec patch by
From: "Victor Fedoseev" <vvf_ru@mail.ru>
To: "Alexandr Petrosian (PAF)" <PAF@design.ru>
Sent: Thursday, January 23, 2003 9:14 AM

huge speedup on ^file::cgi with big result

MethodParams& now [methods without params receive zero reference, but they are expected not to look there]

introducing append_help_length [radical improvement here]

pre-evaluated .count() in some places

introducing string[body]::pos(char)

size_t pos everywhere checks changed to check for eq STRING_NOT_FOUND

2*2 worked :)

empty run passed OK

file.C
table.C compiled

introducing StringBody [C++ CORD wrapper]

$file::exec/cgi[script;
   $.charset[this is script's charset]

command line, env values, input got transcoded before call
stdout, stderr got transcoded after call

^file::exec/cgi now does not pass post data by default.
use: ^file::exec[...;$.stdin[$request.body]

more tests OK

untaint.C 30%,
pa_common.C [done, without http for now]

lots of replacements,
todo:we can ignore lang in cmp and pos really,
		but would split properly!

started porting to gc:
PA_Object done
lots of replacements also

libgc attempt

pa_exec env param made optional

methoded_array now contains all Mxxx classes
SAPI::get_env now returns info on pool
more tests

fixed all cstr's that must use pool [as the one in ^process]

string cmp fixed

fixed all remained bugs of unitialized simple-typed field

parser3.exe - 0 error(s), 0 warning(s)

all compiled, only 14 link errors :)

classes.lib - 0 error(s), 0 warning(s)
parser.C compiled

form compiled

file compiled

date compiled

int compiled

void  compiled :)

grammar compiled

vfile compiled

started main: compile_tools

2002->2003

^file:fullpath[a.gif] when document root did not contain trailing / fixed.

checked http options [invalid onces now reported]
made default
user-agent: paf

table/xdoc/file::load now understand http:// prefix and additional params, sample:
$rates[^xdoc::load[http://www.cbr.ru/scripts/XML_daily.asp?date_req=02/03/2002;
   $.USER-AGENT[parser3]
]]

^file::exec/cgi[file;$.stdin[] << disable HTTP-POST repassing

/some/page.html: ^file:fullpath[a.gif] => /some/a.gif

1.
file spec language changed:
now there are only few chars are untainted:
* ? ' " < > |
and, on unix, : \ ~
[russian letters and SPACES now enabled, one should use ^untaint[uri]{...} now]

2.
$list[^file:list[dir]] now returns simply tainted names in $list.name, not tainted as filespec

@russianindex[]
#dir with files with russian-lang names
$where[dir]

$dir[^file:list[$where;\.txt^$]]
^dir.menu{
	<a href=$where/^untaint[uri]{$dir.name}>$dir.name</a><br>
}

^file::exec/cgi $.stdin[can be file now]
so that one can pass binary data there

pa_request contexts made privated, plus get_{self/method_frame} to read.
Request_context_saver used in ^try to save flang too.
[were not saved]

file::cgi line ends can be both unix & dos. and they can be unix [\n\n] on win when 'use CGI' used, it causes stdout to be binary.
now detected closest header break.

decided not to log exec's with stderr, that could be warnings, and it's up to scritper to log/show them

fixed language of file:file result

^process now prints more precise origin

$f[file::cgi]
$f.UPPER case fields

$file.content-type [instead of .mime-type]
now works for file::stat also

$Date: now$

ident.C* removed

file:find[/can/do/this/now.txt]

marged latest HEAD updates, mainly file:justname&co & @auto/conf[filespec

    !^file:dirname[/a/some.tar.gz]=/a
    !^file:dirname[/a/b/]=/a
    !^file:basename[/a/some.tar.gz]=some.tar.gz
    !^file:justname[/a/some.tar.gz]=some.tar
    !^file:justext[/a/some.tar.gz]=gz

strncasecmp

strcasecmp

^file::exec[script;$.bad error case insensitive check now

^file::exec[script;$.bad now error, not skip

check simplified

suexec env keys filter plus CGI_ as valid prefix

file::exec/cgi to pass HTTP_ vars
introducing SAPI::environment

ovector now local
economy: 16 bytes per ^file:list

removed Value::fname

stderr of execs mark as tainted

finished dual write_xxx_lang functions

started dual write_xxx_lang functions, if checked & works

removed absolutely unnecessary VString shells

killed Request::process() wrapping VString(String) in case we need only String

assigned exception types

f(!forced_allow)
to allow
--with-sendmail to work with any/both
--disable-foreign-group-files --disable-execs

name spelling

2002

rewritten ^cache to use non-blocking-exclusive-caches

^file:lock[filename]{code}

removed redundant pool param to some pa_common funcs

introducing Charset

file::cgi bug, request_method were passed to SERVER_PROTOCOL but SERVER_PROTOCOL were forgotten

$status:db
fixed used not initialized in db_connection & db_table

^string.save[[append;]path]

image&file couple stack string hash.puts

debugging memory
hash key ref now

[Mon Oct 29 16:01:17 2001] total 17050496/202647
[Mon Oct 29 17:11:17 2001] total 16867948/202658

debuggging memory.
string::as_int/double now usually uses stack, not heap [200K out of 17M :)]
VString(String&) not copies reference [29M -> 17M]

^hashfile.hash[]

switched to c++ exceptions 0

lots of params->as_int/double/as_string/as_junction/as_no_junction messages added

header untainting to UL_HTTP_HEADER, UL_MAIL_HEADER made nonforced [only tainted pieces]

started ctype with unicode values

added ident.awk and main.dsp splitted to main+classes+types along to .am

zillions of #ifdef XML
created new projects for sql drivers [planning to remove sql drivers from main cvs project]
first, will join latest changes

dom.xslt  stylesheet compiled&cached

^dom.file[] charset

file:move autocreate/remove dest/src dir

fiew non-pool mallocs fixed

minor bug in file:save fixed

file:load|save[text|binary;

^file:list

exec stderr out

file:move

only ^class:method dynamic calls allowed.
^BASE.method call disabled.
BASE element globally removed

file:exec/cgi msg

$file:exit-code renamed to 'status'

file:exec

$file created by file:state += .atime .mtime .ctime
+found&fixed bug with exceptions on get_junction-created objects [they were on wrong pool]

date  now set $fields roll string.  todo: sql, calendar

*/
static const char *RCSId="$Id: double.C,v 1.31 2001/06/28 07:41:59 parser Exp $";

static char *RCSId="$Id$";

removed m- method dox

renamed pa_methoded back to classes/classes.h

classes/classes renamet to include|main/pa_methoded

configure started

Methoded reorganized. todo: methoded-configure

removed ^a.menu{$name} ability. now
$a{^menu{$name}}
or
^a.menu{$a.name}

beautifying just compiled. todo: debug, configure

beautifying -99

beautifying -100

started beautifying

illegal call check a bit improved, but still under iis no mapping of dir with parser allowed!

z

done: header to $fields. waits for header '\' tricks

SQL_Driver_services renamed. doxygen statics enabled

exec @jav

MethodParams everywhere

image:measure -100 just compiled

all targets exec

exec win32 env

exec env 0

exec4. todo env

uuencode. string<<

junction to code&expression in errors

string:match replace 2.  string.cstr(forced lang)

string:match -10 [frame]

z

string::pos & cmp & piece bugs fixed.
string::split new
table:load separated from set
table:set implemented with clean \n \t searches

static|dynamic|any method registration

table:flip

$request:browser [.type .version]; unknown.get_double now = 0.

file:load autodetection of mime-type by user-file-name

file:load 1. tainted

started file:load. wrong write. must be self.set

table:locate1, file:test

moved ::save to pa_table.
disabled @auto invocation in ^process

file_read stringified

shifted apache branch on main trunc

String::UL_

z

\ to /  and ^file:save

file 1

file class just compiled