hass-core/homeassistant/components/recorder
J. Nick Koston 8b067e83f7
Initial orjson support take 3 ()
* Initial orjson support take 2

Still need to work out problem building wheels

--

Redux of  /  Now possible since the following is solved:
 (comment)

This implements orjson where we use our default encoder.  This does not implement orjson where `ExtendedJSONEncoder` is used as these areas tend to be called far less frequently.  If its desired, this could be done in a followup, but it seemed like a case of diminishing returns (except maybe for large diagnostics files, or traces, but those are not expected to be downloaded frequently).

Areas where this makes a perceptible difference:
- Anything that subscribes to entities (Initial subscribe_entities payload)
- Initial download of registries on first connection / restore
- History queries
- Saving states to the database
- Large logbook queries
- Anything that subscribes to events (appdaemon)

Cavets:
orjson supports serializing dataclasses natively (and much faster) which
eliminates the need to implement `as_dict` in many places
when the data is already in a dataclass. This works
well as long as all the data in the dataclass can also
be serialized. I audited all places where we have an `as_dict`
for a dataclass and found only backups needs to be adjusted (support for `Path` needed to be added for backups).  I was a little bit worried about `SensorExtraStoredData` with `Decimal` but it all seems to work out from since it converts it before it gets to the json encoding cc @dgomes

If it turns out to be a problem we can disable this
with option |= [orjson.OPT_PASSTHROUGH_DATACLASS](https://github.com/ijl/orjson#opt_passthrough_dataclass) and it
will fallback to `as_dict`

Its quite impressive for history queries
<img width="1271" alt="Screen_Shot_2022-05-30_at_23_46_30" src="https://user-images.githubusercontent.com/663432/171145699-661ad9db-d91d-4b2d-9c1a-9d7866c03a73.png">

* use for views as well

* handle UnicodeEncodeError

* tweak

* DRY

* DRY

* not needed

* fix tests

* Update tests/components/http/test_view.py

* Update tests/components/http/test_view.py

* black

* templates
2022-06-22 21:59:51 +02:00
..
system_health Guard MySQL size calculation returning None () 2022-06-10 12:49:58 -07:00
translations [ci skip] Translation update 2022-06-02 00:27:51 +00:00
__init__.py
backup.py
const.py Initial orjson support take 3 () 2022-06-22 21:59:51 +02:00
core.py Initial orjson support take 3 () 2022-06-22 21:59:51 +02:00
db_schema.py Initial orjson support take 3 () 2022-06-22 21:59:51 +02:00
executor.py
filters.py Separate recorder database schema from other classes () 2022-06-07 14:41:43 +02:00
history.py Remove sqlalchemy lambda_stmt usage from history, logbook, and statistics () 2022-06-07 16:15:50 -07:00
manifest.json Bump sqlalchemy to 1.4.37 () 2022-06-01 10:56:05 +02:00
migration.py Separate recorder database schema from other classes () 2022-06-07 14:41:43 +02:00
models.py Initial orjson support take 3 () 2022-06-22 21:59:51 +02:00
pool.py Update pylint to 2.14.3 () 2022-06-19 16:29:57 +02:00
purge.py Separate recorder database schema from other classes () 2022-06-07 14:41:43 +02:00
queries.py Separate recorder database schema from other classes () 2022-06-07 14:41:43 +02:00
repack.py Separate recorder database schema from other classes () 2022-06-07 14:41:43 +02:00
run_history.py Separate recorder database schema from other classes () 2022-06-07 14:41:43 +02:00
services.py
services.yaml
statistics.py Remove sqlalchemy lambda_stmt usage from history, logbook, and statistics () 2022-06-07 16:15:50 -07:00
strings.json
tasks.py
util.py Remove sqlalchemy lambda_stmt usage from history, logbook, and statistics () 2022-06-07 16:15:50 -07:00
websocket_api.py