Plateforme Level Extreme
Abonnement
Profil corporatif
Produits & Services
Support
Légal
English
Replacing a Fox with a Duck... Beware that's a killer be
Message
De
05/04/2023 16:07:07
John Ryan
Captain-Cooker Appreciation Society
Taumata Whakatangi ..., Nouvelle Zélande
 
 
À
05/04/2023 05:40:29
Information générale
Forum:
Python
Catégorie:
Autre
Divers
Thread ID:
01686381
Message ID:
01686455
Vues:
53
>>Numpy, numba, duckdb, arrow.. I have learnt quite a few things dip my toe in the recent big data water à la python recently :-)

It looks as if DuckDB plus Arrow is like a data engine built right into your dev tool, including automagic "streaming" (lazy loading) and analysis of datasets that can even exceed memory!

Wow. I knew somebody would think of that one day. ;-)

The big difference from our antique favourite may be multi-threading and avoidance of the memory parsimony that VFP had to observe back in the old days when 640K memory was enough for anybody.... assuming it's possible to utilize indexes and coherently analyze big chunks of data in multiple threads.
"... They ne'er cared for us
yet: suffer us to famish, and their store-houses
crammed with grain; make edicts for usury, to
support usurers; repeal daily any wholesome act
established against the rich, and provide more
piercing statutes daily, to chain up and restrain
the poor. If the wars eat us not up, they will; and
there's all the love they bear us.
"
-- Shakespeare: Coriolanus, Act 1, scene 1
Précédent
Suivant
Répondre
Fil
Voir

Click here to load this message in the networking platform