[Notes] [Git][BuildGrid/buildgrid][raoul/smarter-bot-calls] 57 commits: Add logging to service gRPC requests

[Raoul Hidalgo Charman <gitlab mg gitlab com>]

Title: GitLab

Raoul Hidalgo Charman pushed to branch raoul/smarter-bot-calls at BuildGrid / buildgrid

Commits:

• 07963525
  by Raoul Hidalgo Charman at 2018-11-08T13:57:26Z

  Add logging to service gRPC requests
  

• aac2f938
  by Raoul Hidalgo Charman at 2018-11-08T13:57:26Z

  cli.py: Allow setting log verbosity level
  

• 76f2e31f
  by Martin Blanchard at 2018-11-08T13:57:26Z

  cli.py: Reset root logger at startup and use default format
  

• dcd82219
  by Martin Blanchard at 2018-11-08T14:50:25Z

  Mark class logger instances as private
  

• dd572340
  by Martin Blanchard at 2018-11-08T16:54:57Z

  Harmonise gRPC servicers debug messages for requests
  

• 6ca668f8
  by Martin Blanchard at 2018-11-12T09:12:58Z

  client/cas.py: Preserve file executability on download
  
  https://gitlab.com/BuildGrid/buildgrid/issues/134
  

• 3512e0bb
  by Martin Blanchard at 2018-11-12T09:13:08Z

  tests/cas/test_client.py: Add a test file for executability
  
  https://gitlab.com/BuildGrid/buildgrid/issues/134
  

• 886e3ff4
  by Laurence Urhegyi at 2018-11-22T18:18:58Z

  Update CONTRIBUTING guide, add COMMITTERS list
  
  Removes some references to a 'meritocratic' project and the Subversion
  policy as they were thought to be un-needed.
  

• 131c6d87
  by Finn at 2018-11-23T09:01:50Z

  buildgrid/_app/commands/cmd_execute.py: Replace logger with execute.
  

• 2360d613
  by Finn at 2018-11-23T09:01:50Z

  buildgrid/_app/commands/cmd_cas.py: Replaced logger with echo.
  

• 15e7a095
  by Finn at 2018-11-23T09:01:50Z

  buildgrid/_app/commands/cmd_operation.py: Replacing logger with echo.
  

• b21c1258
  by Finn at 2018-11-23T09:01:50Z

  buildgrid/_app/commands/cmd_server.py: Replace logger with echo.
  

• 7e184bf9
  by Finn at 2018-11-23T09:01:50Z

  buildgrid/_app/commands/cmd_bot.py: Replaced logger with echo.
  

• 38ed83ba
  by Finn at 2018-11-23T09:01:50Z

  buildgrid_app/bots/: Removed reliance on context for logger.
  

• d0654fea
  by Finn at 2018-11-23T10:47:23Z

  Explictly state the OK code.
  

• 5d88a781
  by Finn at 2018-11-23T10:47:23Z

  Added CancelledError.
  
  This can be used to inform callers that the operation is cancelled.
  

• 152672f0
  by Finn at 2018-11-23T10:47:23Z

  buildgrid/server/execution/service.py: Catch CancelledError.
  

• c21f8116
  by Finn at 2018-11-23T10:47:23Z

  buildgrid/server/operations/service.py: Removed NotImplemented catch.
  

• fe7244f5
  by Finn at 2018-11-23T10:47:23Z

  Implement cancelletion methods in job class.
  

• a938d5f2
  by Finn at 2018-11-23T10:47:23Z

  Added cancellation method to scheduler.
  

• db3e57ac
  by Finn at 2018-11-23T10:47:23Z

  Added cancellation to operations instance.
  

• 555d486f
  by Finn at 2018-11-23T10:47:23Z

  Message queue now queues the job.
  
  Check for operation status when streaming operations.
  Allows client to catch a cancelled job.
  

• 3c51eebc
  by Finn at 2018-11-23T10:54:09Z

  Added cancel command to app.
  

• 5877fe6e
  by Finn at 2018-11-23T10:54:14Z

  tests/integration/operations_service.py: Ammended for cancellation.
  

• c917480a
  by Finn at 2018-11-23T11:18:49Z

  Scheduler can now cancel leases.
  

• fd0c1534
  by Finn at 2018-11-23T11:18:49Z

  BotsInterface now handles cancelled leases.
  
  Removed state machine. Will help with #66.
  

• 1e58b538
  by Finn at 2018-11-23T11:18:49Z

  Added HardwareInterface class.
  
  This will describe and configure hardware.
  

• b7d62408
  by Finn at 2018-11-23T11:18:49Z

  Add Device class.
  

• 17db2b8c
  by Finn at 2018-11-23T11:18:49Z

  Add Worker class.
  

• 694c42ab
  by Finn at 2018-11-23T11:18:49Z

  Remove hardware descriptions from bot_session.
  
  Also move `bot_session` to simply `session`.
  

• 87411369
  by Finn at 2018-11-23T11:41:53Z

  Added Tenant class.
  
  This will contain the information about a running task
  and lease.
  

• b031d8de
  by Finn at 2018-11-23T11:55:31Z

  Added TenantManager class.
  
  This will manage the Tenant objects.
  

• 663f1fd8
  by Finn at 2018-11-23T11:55:31Z

  Modified BotSession to use new TenantManager class.
  

• e8972884
  by Finn at 2018-11-23T15:02:39Z

  buildgrid/bot/bot.py: Close tasks when KeyboardInterupt.
  

• d1cef783
  by Finn at 2018-11-23T15:02:44Z

  Added exception handling to BotInterface.
  
  Also Moved bot_interface.py to interface.py.
  

• b0a1c9c9
  by Finn at 2018-11-23T15:11:01Z

  Moved work function and context argument order.
  
  Also moved the initialisation of these variables to
  the `__init__` of `session.py`.
  

• 1dd8291a
  by Finn at 2018-11-23T15:11:01Z

  Subprocess functions now in separate utils file.
  

• 63e2feaf
  by Finn at 2018-11-23T15:11:01Z

  Updated imports for function `run_in_subprocess`
  

• 24f4117f
  by Finn at 2018-11-23T15:11:01Z

  tests/utils/bots_interface.py: Added new bots_interface mock.
  

• cfdb72d9
  by Finn at 2018-11-23T15:11:01Z

  tests/integration/bot_session.py: Updated to use new subprocess tests.
  
  Also adds cancellation tests.
  

• 6b779d3a
  by Finn at 2018-11-23T15:11:01Z

  tests/integration/bots_service.py: Removed redundant tests.
  
  Mostly due to removing the state machine in the BotsService
  

• f9261257
  by Finn at 2018-11-23T15:11:01Z

  tests/integration/operations_service.py: Removing redundant test.
  

• 96eef9a5
  by Finn at 2018-11-23T15:11:01Z

  Added unittests for hardware interface.
  

• 45908b7e
  by Martin Blanchard at 2018-11-26T10:17:22Z

  storage_abc.py: Fix unnecessary pass linting issues
  

• 144df7b0
  by Martin Blanchard at 2018-11-26T10:23:32Z

  tests: Fix literal comparison linting issues
  

• 6c540071
  by Martin Blanchard at 2018-11-26T10:30:08Z

  Add private .proto file for monitoring bus messages
  
  https://gitlab.com/BuildGrid/buildgrid/issues/135
  

• 96c6281e
  by Martin Blanchard at 2018-11-26T10:30:08Z

  _enums.py: Expose Python Enums for monitoring.proto
  
  https://gitlab.com/BuildGrid/buildgrid/issues/135
  

• bab83a4b
  by Martin Blanchard at 2018-11-26T10:30:08Z

  monitoring.py: New monitoring bus class
  
  https://gitlab.com/BuildGrid/buildgrid/issues/135
  

• 1f5d9210
  by Martin Blanchard at 2018-11-26T10:30:08Z

  Handle the server's main event loop internally
  
  This turns Server.start() into a blocking call!
  
  https://gitlab.com/BuildGrid/buildgrid/issues/135
  

• e102e2d3
  by Martin Blanchard at 2018-11-26T10:30:08Z

  server/instance.py: Run monitoring bus in main event loop
  
  https://gitlab.com/BuildGrid/buildgrid/issues/135
  

• 31533b69
  by Martin Blanchard at 2018-11-26T10:30:08Z

  server/instance.py: Handle SIGTERM gracefully
  
  https://gitlab.com/BuildGrid/buildgrid/issues/135
  

• cc1676ed
  by Martin Blanchard at 2018-11-26T10:30:08Z

  server/instance.py: Return number of bound port
  
  Useful for tests, when port number is not determined beforehand.
  
  https://gitlab.com/BuildGrid/buildgrid/issues/135
  

• 1a8dff34
  by Martin Blanchard at 2018-11-26T10:30:08Z

  cas/service.py: Better parse resource names
  
  https://gitlab.com/BuildGrid/buildgrid/issues/135
  

• 66119b01
  by Martin Blanchard at 2018-11-26T10:30:08Z

  tests/utils/server.py: New server helper
  
  https://gitlab.com/BuildGrid/buildgrid/issues/135
  

• 40a7a09a
  by Martin Blanchard at 2018-11-26T10:30:08Z

  test/server_instance.py: Adapt to new blocking API
  
  https://gitlab.com/BuildGrid/buildgrid/issues/135
  

• 29b46acf
  by Raoul Hidalgo Charman at 2018-11-27T14:25:12Z

  Smarter bot calls
  
  Bots now have a timeout option, which the server looks at to determine how
  long they wait on a job becoming available. As soon as a job becomes available
  server responds with a lease. If it gets to the timeout then the server will
  tell the bot there is no work and it will then update again and wait.
  

• f995195d
  by Raoul Hidalgo Charman at 2018-11-27T15:01:18Z

  Bot: Reconnects and timeouts on the bot side
  

30 changed files:

• + COMMITTERS.md
• CONTRIBUTING.rst
• − MAINTAINERS
• buildgrid/_app/bots/buildbox.py
• buildgrid/_app/bots/dummy.py
• buildgrid/_app/bots/host.py
• buildgrid/_app/cli.py
• buildgrid/_app/commands/cmd_bot.py
• buildgrid/_app/commands/cmd_cas.py
• buildgrid/_app/commands/cmd_execute.py
• buildgrid/_app/commands/cmd_operation.py
• buildgrid/_app/commands/cmd_server.py
• buildgrid/_enums.py
• buildgrid/_exceptions.py
• + buildgrid/_protos/buildgrid/__init__.py
• + buildgrid/_protos/buildgrid/v2/__init__.py
• + buildgrid/_protos/buildgrid/v2/monitoring.proto
• + buildgrid/_protos/buildgrid/v2/monitoring_pb2.py
• + buildgrid/_protos/buildgrid/v2/monitoring_pb2_grpc.py
• buildgrid/bot/bot.py
• − buildgrid/bot/bot_session.py
• + buildgrid/bot/hardware/__init__.py
• + buildgrid/bot/hardware/device.py
• + buildgrid/bot/hardware/interface.py
• + buildgrid/bot/hardware/worker.py
• buildgrid/bot/bot_interface.py → buildgrid/bot/interface.py
• + buildgrid/bot/session.py
• + buildgrid/bot/tenant.py
• + buildgrid/bot/tenantmanager.py
• buildgrid/client/cas.py

The diff was not included because it is too large.

—
View it on GitLab.
You're receiving this email because of your account on gitlab.com. If you'd like to receive fewer emails, you can adjust your notification settings.