skytools.git
10 years agoMerge branch 'hotfix/3.2.6' master 3.2.6
martinko [Wed, 5 Nov 2014 15:00:53 +0000 (16:00 +0100)]
Merge branch 'hotfix/3.2.6'

10 years agov3.2.6
martinko [Wed, 5 Nov 2014 15:00:33 +0000 (16:00 +0100)]
v3.2.6

10 years agoMerge branch 'develop' into hotfix/3.2.6
martinko [Wed, 5 Nov 2014 14:59:38 +0000 (15:59 +0100)]
Merge branch 'develop' into hotfix/3.2.6

10 years agofixed subscriber_info_watermark_name_fkey violation
martinko [Wed, 5 Nov 2014 14:45:06 +0000 (15:45 +0100)]
fixed subscriber_info_watermark_name_fkey violation

10 years agoMerge branch 'hotfix/3.2.5' 3.2.5
martinko [Wed, 29 Oct 2014 08:51:14 +0000 (09:51 +0100)]
Merge branch 'hotfix/3.2.5'

10 years agoMerge branch 'hotfix/3.2.5' into develop
martinko [Wed, 29 Oct 2014 08:51:14 +0000 (09:51 +0100)]
Merge branch 'hotfix/3.2.5' into develop

10 years agov3.2.5
martinko [Wed, 29 Oct 2014 08:50:17 +0000 (09:50 +0100)]
v3.2.5

10 years agobumping up schemata's versions in preparation for upcoming release
martinko [Wed, 29 Oct 2014 08:43:02 +0000 (09:43 +0100)]
bumping up schemata's versions in preparation for upcoming release

10 years agoMerge branch 'master' of https://github.com/markokr/skytools into hotfix/3.2.5
martinko [Wed, 29 Oct 2014 08:41:14 +0000 (09:41 +0100)]
Merge branch 'master' of https://github.com/markokr/skytools into hotfix/3.2.5

10 years agosql/pgq_ext/structure/tables.sql: fixed some typos
martinko [Wed, 29 Oct 2014 08:40:10 +0000 (09:40 +0100)]
sql/pgq_ext/structure/tables.sql: fixed some typos

10 years agofixed subscriber_info_watermark_name_fkey violation
martinko [Wed, 29 Oct 2014 08:38:39 +0000 (09:38 +0100)]
fixed subscriber_info_watermark_name_fkey violation

(introduced in commit 0466144)

10 years agopgq_node: avoid concurrency in promote/demote
Marko Kreen [Mon, 27 Oct 2014 13:51:42 +0000 (15:51 +0200)]
pgq_node: avoid concurrency in promote/demote

10 years agoparse_iso_timestamp: handle Z properly
Marko Kreen [Mon, 27 Oct 2014 13:50:26 +0000 (15:50 +0200)]
parse_iso_timestamp: handle Z properly

10 years agoMerge branch 'hotfix/3.2.4' 3.2.4
martinko [Mon, 27 Oct 2014 09:53:23 +0000 (10:53 +0100)]
Merge branch 'hotfix/3.2.4'

10 years agoMerge branch 'hotfix/3.2.4' into develop
martinko [Mon, 27 Oct 2014 09:53:23 +0000 (10:53 +0100)]
Merge branch 'hotfix/3.2.4' into develop

10 years agov3.2.4
martinko [Mon, 27 Oct 2014 09:53:08 +0000 (10:53 +0100)]
v3.2.4

10 years agomoved log msg about script's normal shutdown from BaseScript to DataMaintainer
martinko [Fri, 10 Oct 2014 13:50:38 +0000 (15:50 +0200)]
moved log msg about script's normal shutdown from BaseScript to DataMaintainer

I think this could be useful to others but it's got to move until a better solution is figured out.

10 years agominor changelog fix
martinko [Wed, 8 Oct 2014 10:32:23 +0000 (12:32 +0200)]
minor changelog fix

10 years agomoved log msg about script's normal shutdown from BaseScript to DataMaintainer
martinko [Fri, 10 Oct 2014 13:50:38 +0000 (15:50 +0200)]
moved log msg about script's normal shutdown from BaseScript to DataMaintainer

I think this could be useful to others but it's got to move until a better solution is figured out.

10 years agominor changelog fix
martinko [Wed, 8 Oct 2014 10:32:23 +0000 (12:32 +0200)]
minor changelog fix

10 years agoMerge branch 'release/3.2.3' 3.2.3
martinko [Wed, 8 Oct 2014 08:44:04 +0000 (10:44 +0200)]
Merge branch 'release/3.2.3'

10 years agoMerge branch 'release/3.2.3' into develop
martinko [Wed, 8 Oct 2014 08:44:04 +0000 (10:44 +0200)]
Merge branch 'release/3.2.3' into develop

10 years agov3.2.3
martinko [Wed, 8 Oct 2014 08:43:04 +0000 (10:43 +0200)]
v3.2.3

10 years agopgq.cascade.admin: fixed takeover ("cannot subscribe to itself")
martinko [Wed, 8 Oct 2014 08:35:22 +0000 (10:35 +0200)]
pgq.cascade.admin: fixed takeover ("cannot subscribe to itself")

10 years agobumping up schemata's versions in preparation for upcoming release
martinko [Mon, 6 Oct 2014 14:26:09 +0000 (16:26 +0200)]
bumping up schemata's versions in preparation for upcoming release

10 years agoskytools.scripting: minor touch
martinko [Mon, 6 Oct 2014 14:02:03 +0000 (16:02 +0200)]
skytools.scripting: minor touch

10 years agoMerge branch 'master' of https://github.com/markokr/skytools into develop
martinko [Mon, 6 Oct 2014 13:59:43 +0000 (15:59 +0200)]
Merge branch 'master' of https://github.com/markokr/skytools into develop

10 years agowalmgr: ignore .history files when removing PG_RECEIVEXLOG file
Tarvi Pillessaar [Mon, 6 Oct 2014 11:57:30 +0000 (14:57 +0300)]
walmgr: ignore .history files when removing PG_RECEIVEXLOG file
PG_RECEIVEXLOG got removed too early due to .history files that were not present

10 years agolondiste.list_obsolete_partitions: removed lower-casing of parent table name
martinko [Fri, 3 Oct 2014 12:25:25 +0000 (14:25 +0200)]
londiste.list_obsolete_partitions: removed lower-casing of parent table name

10 years agolondiste.handlers.dispatch: improved ignoring of events aiming at obsolete partitions
martinko [Fri, 3 Oct 2014 11:36:49 +0000 (13:36 +0200)]
londiste.handlers.dispatch: improved ignoring of events aiming at obsolete partitions

Partition is never created if it is already known to be obsolete (and so to be dropped).

10 years agoMerge branch 'master' of git://github.com/markokr/skytools
Marko Kreen [Thu, 7 Aug 2014 13:31:45 +0000 (16:31 +0300)]
Merge branch 'master' of git://github.com/markokr/skytools

10 years agocascadeadmin: allow drop-node of root
Marko Kreen [Thu, 7 Aug 2014 13:03:41 +0000 (16:03 +0300)]
cascadeadmin: allow drop-node of root

10 years agopgq: clean up pgq.consumer when consumer is unregistered
martinko [Tue, 5 Aug 2014 12:16:41 +0000 (14:16 +0200)]
pgq: clean up pgq.consumer when consumer is unregistered

The goal is to leave no "garbage" that accumulates over time.

10 years agoBaseScript: added log msg about script's normal shutdown
martinko [Thu, 31 Jul 2014 07:55:51 +0000 (09:55 +0200)]
BaseScript: added log msg about script's normal shutdown

10 years agoMerge branch 'master' of https://github.com/markokr/skytools into develop
martinko [Fri, 25 Jul 2014 08:22:49 +0000 (10:22 +0200)]
Merge branch 'master' of https://github.com/markokr/skytools into develop

10 years agopgq_node.tables: added foreign key and fixed comments
martinko [Fri, 25 Jul 2014 08:19:44 +0000 (10:19 +0200)]
pgq_node.tables: added foreign key and fixed comments

10 years agoMerge pull request #37 from mrrusof/fix-execute-skip
Marko Kreen [Tue, 22 Jul 2014 18:49:27 +0000 (21:49 +0300)]
Merge pull request #37 from mrrusof/fix-execute-skip

Fix execute skip

10 years agoStandardize log messages about skipping execution of sql script.
Ruslan Ledesma Garza [Wed, 16 Jul 2014 18:28:13 +0000 (13:28 -0500)]
Standardize log messages about skipping execution of sql script.

10 years agoSkip execution of sql script when already executed.
Ruslan Ledesma Garza [Wed, 16 Jul 2014 18:27:59 +0000 (13:27 -0500)]
Skip execution of sql script when already executed.

10 years agoMerge pull request #36 from piffio/syslog-facility-support
Marko Kreen [Fri, 4 Jul 2014 12:00:18 +0000 (15:00 +0300)]
Merge pull request #36 from piffio/syslog-facility-support

Add support for syslog facility in pgqd

10 years agoAdd support for syslog facility in pgqd
Sergio Visinoni [Fri, 4 Jul 2014 01:12:53 +0000 (20:12 -0500)]
Add support for syslog facility in pgqd

Add support for defining the syslog facility we want pgqd to
log to in the ini file, since this is supported in libusual.

10 years agoFix londiste_provider regtest.
Marko Kreen [Sat, 17 May 2014 13:18:30 +0000 (16:18 +0300)]
Fix londiste_provider regtest.

Sync with recent changes.

11 years agoMerge pull request #31 from bitmonk/fix_simple_tutorial
Marko Kreen [Wed, 16 Apr 2014 17:05:56 +0000 (20:05 +0300)]
Merge pull request #31 from bitmonk/fix_simple_tutorial

actual different nodes are a helpful example case

11 years agoactual different nodes are a helpful example case
Justin Alan Ryan [Thu, 10 Apr 2014 23:12:24 +0000 (16:12 -0700)]
actual different nodes are a helpful example case

11 years agoMerge branch 'hotfix/3.2.2' 3.2.2
martinko [Thu, 10 Apr 2014 12:09:48 +0000 (14:09 +0200)]
Merge branch 'hotfix/3.2.2'

11 years agoMerge branch 'hotfix/3.2.2' into develop
martinko [Thu, 10 Apr 2014 12:09:48 +0000 (14:09 +0200)]
Merge branch 'hotfix/3.2.2' into develop

11 years agov3.2.2
martinko [Thu, 10 Apr 2014 12:09:12 +0000 (14:09 +0200)]
v3.2.2

11 years agoMerge branch 'master' of https://github.com/markokr/skytools into hotfix/3.2.2
martinko [Thu, 10 Apr 2014 12:03:38 +0000 (14:03 +0200)]
Merge branch 'master' of https://github.com/markokr/skytools into hotfix/3.2.2

11 years agoUpgrade libusual to master, rewrite pgqd Makefile
Marko Kreen [Thu, 10 Apr 2014 11:52:45 +0000 (14:52 +0300)]
Upgrade libusual to master, rewrite pgqd Makefile

Old setup.mk is now dropped in libusual, convert
pgqd to use antimake.mk instead.

11 years agoMerge branch 'hotfix/3.2.1' 3.2.1
martinko [Wed, 9 Apr 2014 15:59:41 +0000 (17:59 +0200)]
Merge branch 'hotfix/3.2.1'

11 years agoMerge branch 'hotfix/3.2.1' into develop
martinko [Wed, 9 Apr 2014 15:59:41 +0000 (17:59 +0200)]
Merge branch 'hotfix/3.2.1' into develop

11 years agov3.2.1
martinko [Wed, 9 Apr 2014 15:56:55 +0000 (17:56 +0200)]
v3.2.1

11 years agomoved psycopg2 reference from scripting module to actual script using it
martinko [Wed, 9 Apr 2014 15:36:44 +0000 (17:36 +0200)]
moved psycopg2 reference from scripting module to actual script using it

11 years agoskytools.scripting: moved psycopg2 import where it belongs
martinko [Wed, 9 Apr 2014 15:25:14 +0000 (17:25 +0200)]
skytools.scripting: moved psycopg2 import where it belongs

11 years agoMerge commit 'bbcd65e4e74e705e0cc07a549bda73e37e20012a' into hotfix/3.2.1
martinko [Wed, 9 Apr 2014 15:22:50 +0000 (17:22 +0200)]
Merge commit 'bbcd65e4e74e705e0cc07a549bda73e37e20012a' into hotfix/3.2.1

11 years agoMerge branch 'develop' into hotfix/3.2.1
martinko [Wed, 9 Apr 2014 15:21:43 +0000 (17:21 +0200)]
Merge branch 'develop' into hotfix/3.2.1

11 years agoskytools.timeutil: fixed for Python versions less than 2.7
martinko [Tue, 8 Apr 2014 09:45:12 +0000 (11:45 +0200)]
skytools.timeutil: fixed for Python versions less than 2.7

11 years agosetup_skytools.py: fixes
martinko [Mon, 7 Apr 2014 12:33:23 +0000 (14:33 +0200)]
setup_skytools.py: fixes

11 years agolibusual updated to the latest version (that is already 9 months old)
martinko [Mon, 7 Apr 2014 10:32:06 +0000 (12:32 +0200)]
libusual updated to the latest version (that is already 9 months old)

11 years agoMerge remote-tracking branch 'gamato/master'
Marko Kreen [Thu, 3 Apr 2014 15:18:03 +0000 (18:18 +0300)]
Merge remote-tracking branch 'gamato/master'

11 years agoUpdate setup*.py to point to correct license.
Marko Kreen [Wed, 2 Apr 2014 17:48:13 +0000 (20:48 +0300)]
Update setup*.py to point to correct license.

11 years agoMerge branch 'release/3.2' skytools_3_2
martinko [Wed, 2 Apr 2014 14:55:14 +0000 (16:55 +0200)]
Merge branch 'release/3.2'

11 years agoMerge branch 'release/3.2' into develop
martinko [Wed, 2 Apr 2014 14:55:14 +0000 (16:55 +0200)]
Merge branch 'release/3.2' into develop

11 years agobumped up version to 3.2
martinko [Tue, 1 Apr 2014 12:45:51 +0000 (14:45 +0200)]
bumped up version to 3.2

let's get trendy ... it's no good to be stuck on same minor version for so long ;-)
and it actually did not make sense ... quite a few important features appeared

11 years agobumped up version to 3.1.6rc2
martinko [Mon, 17 Mar 2014 15:29:15 +0000 (16:29 +0100)]
bumped up version to 3.1.6rc2

11 years agoNEWS: updated
martinko [Mon, 17 Mar 2014 15:24:28 +0000 (16:24 +0100)]
NEWS: updated

11 years agolondiste.upgrade_schema: fixed condition_timing vs action_timing
martinko [Mon, 17 Mar 2014 15:21:50 +0000 (16:21 +0100)]
londiste.upgrade_schema: fixed condition_timing vs action_timing

11 years agotypos
martinko [Mon, 17 Mar 2014 15:20:52 +0000 (16:20 +0100)]
typos

11 years agobumping up versions in preparation for upcoming release
martinko [Thu, 20 Feb 2014 15:08:56 +0000 (16:08 +0100)]
bumping up versions in preparation for upcoming release

11 years agoMerge branch 'master' of https://github.com/markokr/skytools into develop
martinko [Thu, 20 Feb 2014 13:40:37 +0000 (14:40 +0100)]
Merge branch 'master' of https://github.com/markokr/skytools into develop

11 years agolondiste.create_partition: fixed to avoid deadlocks from concurrent workers
martinko [Wed, 19 Feb 2014 12:44:58 +0000 (13:44 +0100)]
londiste.create_partition: fixed to avoid deadlocks from concurrent workers

11 years agoMerge pull request #29 from andrewsw-janrain/master
Marko Kreen [Tue, 18 Feb 2014 15:07:28 +0000 (17:07 +0200)]
Merge pull request #29 from andrewsw-janrain/master

quote sequence names

11 years agoscripts/data_maintainer.py: fixed to survive null in stats column of sql_modify
martinko [Tue, 18 Feb 2014 13:52:20 +0000 (14:52 +0100)]
scripts/data_maintainer.py: fixed to survive null in stats column of sql_modify

11 years agoquote sequence names
Andrew Sackville-West [Tue, 4 Feb 2014 18:47:31 +0000 (10:47 -0800)]
quote sequence names

fixes a bug where _load_elem fails on sequences in schemas that start
with non-alpha characters.

11 years agoMerge branch 'master' of https://github.com/markokr/skytools into develop
martinko [Mon, 3 Feb 2014 08:28:08 +0000 (09:28 +0100)]
Merge branch 'master' of https://github.com/markokr/skytools into develop

Conflicts:
debian/changelog

11 years agoskytools.scripting: allow to specify exception(s) to suppress for a grace period
martinko [Thu, 30 Jan 2014 13:08:34 +0000 (14:08 +0100)]
skytools.scripting: allow to specify exception(s) to suppress for a grace period

It is possible to provide a list of exception names, or reserved keyword “ALL”.

11 years agoskytools.scripting: added options to lower log level for exceptions
martinko [Tue, 28 Jan 2014 16:04:25 +0000 (17:04 +0100)]
skytools.scripting: added options to lower log level for exceptions

The idea is to suppress error level log messages for a grace period
in order not to pollute logs with transient errors that nobody would act upon.

11 years agoMerge branch 'feature/retriable_execute' into develop
martinko [Tue, 28 Jan 2014 13:56:29 +0000 (14:56 +0100)]
Merge branch 'feature/retriable_execute' into develop

11 years agocleaned up, even more robust, added logging, feature inactive by default
martinko [Fri, 10 Jan 2014 17:37:22 +0000 (18:37 +0100)]
cleaned up, even more robust, added logging, feature inactive by default

11 years agomade more robust, returns retry count and valid cursor
martinko [Wed, 8 Jan 2014 15:00:13 +0000 (16:00 +0100)]
made more robust, returns retry count and valid cursor

11 years agoanother iteration from past
martinko [Wed, 8 Jan 2014 11:54:08 +0000 (12:54 +0100)]
another iteration from past

11 years agosimple retriable execute (for sql)
martinko [Wed, 18 Dec 2013 16:16:43 +0000 (17:16 +0100)]
simple retriable execute (for sql)

the idea is that db calls occasionally break due to transient issues and we’d rather have the calls retried before raising exceptions etc

11 years agolondiste.handlers: removed duplicate debug logging
martinko [Tue, 28 Jan 2014 10:47:02 +0000 (11:47 +0100)]
londiste.handlers: removed duplicate debug logging

11 years agopgq.cascade.admin: do not allow subscribing to itself (same node)
martinko [Thu, 23 Jan 2014 12:00:53 +0000 (14:00 +0200)]
pgq.cascade.admin: do not allow subscribing to itself (same node)

11 years agopgq.localconsumer: added file path check on config load
martinko [Mon, 13 Jan 2014 14:17:37 +0000 (15:17 +0100)]
pgq.localconsumer: added file path check on config load

11 years agoscripts/data_maintainer.py: fixes
martinko [Wed, 18 Dec 2013 15:16:41 +0000 (16:16 +0100)]
scripts/data_maintainer.py: fixes

11 years agoscripts/data_maintainer.py: latest code cleanup
martinko [Tue, 17 Dec 2013 14:54:45 +0000 (15:54 +0100)]
scripts/data_maintainer.py: latest code cleanup

11 years agoMerge branch 'develop' of skype-git:/git/users/petr.jelinek/skytools-3 into develop
martinko [Mon, 16 Dec 2013 16:04:13 +0000 (17:04 +0100)]
Merge branch 'develop' of skype-git:/git/users/petr.jelinek/skytools-3 into develop

11 years agoupdated londiste.upgrade_schema with fix for londiste.table_info trigger issue
martinko [Sat, 7 Dec 2013 15:15:44 +0000 (16:15 +0100)]
updated londiste.upgrade_schema with fix for londiste.table_info trigger issue

11 years agofixed londiste.table_info trigger issue
martinko [Fri, 6 Dec 2013 08:53:46 +0000 (09:53 +0100)]
fixed londiste.table_info trigger issue

11 years agoMerge branch 'hotfix/3.1.5.4' 3.1.5.4
martinko [Tue, 3 Dec 2013 14:58:47 +0000 (15:58 +0100)]
Merge branch 'hotfix/3.1.5.4'

11 years agoMerge branch 'hotfix/3.1.5.4' into develop
martinko [Tue, 3 Dec 2013 14:58:47 +0000 (15:58 +0100)]
Merge branch 'hotfix/3.1.5.4' into develop

11 years agodebian/changelog: updated
martinko [Tue, 3 Dec 2013 14:46:52 +0000 (15:46 +0100)]
debian/changelog: updated

11 years agolondiste.handlers.dispatch: fixed "ignore events aiming at obsolete partitions" bug
martinko [Tue, 3 Dec 2013 14:46:09 +0000 (15:46 +0100)]
londiste.handlers.dispatch: fixed "ignore events aiming at obsolete partitions" bug

but really :-)

11 years agosql/pgq: tag pgq.batch_id_seq as dumpable (extension)
Marko Kreen [Wed, 30 Oct 2013 23:35:05 +0000 (01:35 +0200)]
sql/pgq: tag pgq.batch_id_seq as dumpable (extension)

That case was broken in old 9.1 releases, fixed since 9.1.7.

The sequence will be owned by extension and without tagging
it will not be dumped in data dump.

11 years agopython/pgq: fixes (event & walker)
martinko [Mon, 11 Nov 2013 14:22:53 +0000 (15:22 +0100)]
python/pgq: fixes (event & walker)

11 years agoDataMaintainer can use csv file as source.
Petr Jelinek [Sun, 1 Dec 2013 23:55:15 +0000 (00:55 +0100)]
DataMaintainer can use csv file as source.

11 years agopython/pgq: fixes (event & walker)
martinko [Mon, 11 Nov 2013 14:22:53 +0000 (15:22 +0100)]
python/pgq: fixes (event & walker)

11 years agoset_tcp_keepalive: simplify, enable win32
Marko Kreen [Wed, 6 Nov 2013 00:03:51 +0000 (02:03 +0200)]
set_tcp_keepalive: simplify, enable win32

The code got messy, clean it up.

Also, seems like Python 2.7+ support SIO_KEEPALIVE_VALS,
enable it's usage.

11 years agoskytools.set_tcp_keepalive: add compat with newer OSX
Marko Kreen [Tue, 5 Nov 2013 23:28:31 +0000 (01:28 +0200)]
skytools.set_tcp_keepalive: add compat with newer OSX

Newer OSX has Linux-style TCP_KEEPIDLE/TCP_KEEPCNT
socket options, but TCP_KEEPIDLE is missing, instead
it has old well-hidden TCP_KEEPALIVE option.  So it
branches into Linux section and fails there.

This patch detects every Linux option separately
and uses TCP_KEEPALIVE instead TCP_KEEPIDLE
on Darwin.

It does expect that Python is compiled against current
OSX versions, and headers match running kernel.  So if
option is defined in 'socket' module, it works.

Reported-by: Rob Fowler