Commit graph

213 commits

Author SHA1 Message Date
asonix
dfba0cf7f2 Filter by job-readiness as well 2019-05-25 18:09:10 -05:00
asonix
0a509e0271 Queue as many jobs as we can on ping
This change isn't incredibly important, but in cases where more than one
jobs server is running, and one happens to get a heavy amount of new job
traffic while the others get very few, it is possible that we can end up
with unprocessed jobs in the DB while not every worker is busy. This
change exausts our worker queue on ping if there are jobs available
2019-05-25 17:10:32 -05:00
asonix
875eec57dd Bump versions 2019-05-25 16:41:58 -05:00
asonix
2a6612225a Update cargo toml 2019-05-25 16:39:52 -05:00
asonix
e43abbfaaa Add lock on queue traversal 2019-05-25 16:39:16 -05:00
asonix
d3987768a5 Update readme, main repo docs 2019-05-25 16:15:09 -05:00
asonix
986a08b7e9 Update repo links 2019-05-25 15:33:38 -05:00
asonix
df932f6699 Organize sled 2019-05-25 15:32:17 -05:00
asonix
5b13908886 2019 2019-05-25 15:26:12 -05:00
asonix
f2a694879c Revamp background-jobs with pluggable backends 2019-05-25 15:22:26 -05:00
asonix
edd63abf0f Relax bounds 2019-05-23 22:41:34 -05:00
asonix
2968ba5360 Drop tokio 2019-05-23 22:25:00 -05:00
asonix
d1aeb6c139 Bump actix 2019-05-21 15:04:06 -05:00
asonix
94d0fd9a02
Job IDs start at 1, not 2 2018-12-18 17:11:02 -06:00
asonix
2fea1e8e69
Tick before increment, tick on fetch 2018-12-18 17:09:10 -06:00
asonix
c6682d2fc9
Bump version (again) 2018-12-18 16:55:40 -06:00
asonix
2e10a14ed4
Bump version 2018-12-18 16:54:01 -06:00
asonix
fcfc85cb69
Add statistics, and expose them through jobs-actix 2018-12-18 16:50:47 -06:00
asonix
975c20bd85
Add crate info for jobs-actix 2018-12-16 13:57:09 -06:00
asonix
3529b3ae08
Re-set default async zmq impl 2018-12-16 13:53:21 -06:00
asonix
a7b494ca39
Prepare release 2018-12-16 13:44:25 -06:00
asonix
a22d10242a
Fix jobs-server 2018-12-16 13:14:46 -06:00
asonix
d266315f1f
Add jobs-actix 2018-12-16 12:43:44 -06:00
asonix
6e79341b38
Add scheduled jobs, fix spawning non-default jobs 2018-12-13 11:08:28 -06:00
asonix
8a78f9e129 Bump KV dep 2018-11-19 20:38:45 -06:00
asonix
2438fbcdaf Remove 'ignore' from readme 2018-11-18 15:10:18 -06:00
asonix
ecf3efd9fb Update README version 2018-11-18 15:05:57 -06:00
asonix
4f2530d485 Add application state 2018-11-18 15:05:03 -06:00
asonix
58f794dc55 Update docs, use associated constants, add queue_sync 2018-11-18 08:45:12 -06:00
asonix
803a242a46 Oops, fix doc links 2018-11-17 19:52:36 -06:00
asonix
843b5407e8 Update metadata again 2018-11-17 19:46:42 -06:00
asonix
3553e2bdf8 Update metadata for other crates in the project 2018-11-17 19:43:45 -06:00
asonix
6878a8b3d2 Add metadata to core toml 2018-11-17 19:41:21 -06:00
asonix
cf6ede67ea Add documentation, license info, Make API cleaner 2018-11-17 19:39:04 -06:00
asonix
c23aa0961d Remove jobs-actix, jobs-tokio 2018-11-17 17:00:43 -06:00
asonix
6ae02e08cb Delete actix and tokio examples 2018-11-17 16:59:16 -06:00
asonix
c8f1f6cd34 Mark jobs staged, not running
Clear staged jobs on startup
2018-11-16 19:10:45 -06:00
asonix
9cff817ed6 Rename crate, update TODO 2018-11-16 18:14:33 -06:00
asonix
960c0235c4 Update tokio-zmq, optionally use futures-zmq instead 2018-11-16 18:09:53 -06:00
asonix
a877b5c9e8 Apply backpressure in pushers, portmap 2018-11-11 12:42:10 -06:00
asonix
c0fcedf8a1 Add queues, make fault tolerant 2018-11-10 22:46:46 -06:00
asonix
0cfec96d4e Introduce queues to server 2018-11-10 21:15:21 -06:00
asonix
02406de28d Write up TODO 2018-11-10 16:51:21 -06:00
asonix
dbb8144673 Use Push and Pull to transmit jobs. No more req/rep issues 2018-11-10 15:58:19 -06:00
asonix
87db89b35a Don't push db 2018-11-07 23:48:42 -06:00
asonix
e70a6b80e4 Make jobs processor accessible over a network 2018-11-07 23:47:11 -06:00
asonix
77fa5c0df7 Add client/server processor 2018-11-07 22:49:27 -06:00
asonix
afff778309 Split core into multiple files 2018-11-07 20:20:30 -06:00
asonix
5b8ec51e33 Generate jobs rather than writing out each one 2018-11-07 20:03:39 -06:00
asonix
3f6e27a9f7 Avoid unwraps by removing the need to parse 2018-11-07 19:59:21 -06:00