[ts-gen] How symbols and contracts are defined during database creation

sam sam_backtester at yahoo.fr
Mon Sep 8 06:47:08 EDT 2008

I have some issues...

With the 080829 version, and a fresh "trading" database, the "select wild STK ..." commands fails, with, here, AA for example:
./shim --data file save wild                           -> OK
select past 1 5 Ymd_T(20080826 15:30:00)  -> OK
select wild STK AA all                                -> NOK
tail ShimText:
1565|44899|190456593|3|1|1|2008082615:28:00|31.57|31.59|31.57|31.58|70|31.57|false|STK:SMART:AA:1565|44899| 190456613|3|1|1|2008082615:29:00|31.59|31.6|31.58|31.6|33|31.59|false|STK:SMART:AA:1565|44899| 190498076|4|110| 0|# |4|110|0|event: history insert|(2408, 5, 20080826  13:30:00 --20080826 15:29:00)|
1565|44748|  39172082|1| 9| 0|select wild STK AA all;|
1565|44748|  39172126|2| 9| 3|9|3|AA|STK||0.00||1||||1|
1565|44748|  39331380|3| 4| 2|      -1| 200|No security definition has been found for the request|

I tried some other "wild" request for other contracts, but I have the same problem.

Did I miss something ?

--- En date de : Sam 6.9.08, Bill Pippin <pippin at owlriver.net> a écrit :
De: Bill Pippin <pippin at owlriver.net>
Objet: Re: [ts-gen] How symbols and contracts are defined during database creation
À: sam_backtester at yahoo.fr, "trading-shim general mailing list" <ts-general at trading-shim.org>
Date: Samedi 6 Septembre 2008, 3h55


Based on your report, I've fixed the problem with STK:35052259
in the most recent release.

That being said, such incremental fixes to the database are
probably not satisfactory to either of us, certainly not for
the long run, and I suspect that eventually there will be
scripts that each user will need to run to preen the database.

Perfecting the symbols data in the distribution beyond what
we can obtain externally is problematic, for at least two reasons:
we can not distribute information received via the api, and api
contract details vary from one account to the next.

By way of example, for queries against symbols STK:GSZ and STK:GAZ,
for a shim running against my current paper account, and with the
wild card command line option, e.g.:

    ./shim --data file save wild

then the commands:

    select wild STK GAZ  all;	wait 1;
    select wild STK GBZ  all;	wait 1;

return only three distinct contracts:

    3|10| 4|GBZ|STK||0.0||ASX     |AUD|GBZ|GBZ|GBZ|46933587|0.0010 ...

    3|10| 4|GAZ|STK||0.0||SMART   |CAD|GAZ|GAZ|GAZ|44531001|0.0050 ...
    3|10| 4|GAZ|STK||0.0||VENTURE |CAD|GAZ|GAZ|GAZ|44531001|0.0050 ...

    3|10| 4|GAZ|STK||0.0||SMART   |USD|GAZ|GAZ|GAZ|46943368|0.01   ...
    3|10| 4|GAZ|STK||0.0||ARCA    |USD|GAZ|GAZ|GAZ|46943368|0.01   ...
    3|10| 4|GAZ|STK||0.0||BATS    |USD|GAZ|GAZ|GAZ|46943368|0.01   ...
    3|10| 4|GAZ|STK||0.0||CSFBALGO|USD|GAZ|GAZ|GAZ|46943368|0.01   ...
    3|10| 4|GAZ|STK||0.0||DRCTEDGE|USD|GAZ|GAZ|GAZ|46943368|0.01   ...
    3|10| 4|GAZ|STK||0.0||EDGEA   |USD|GAZ|GAZ|GAZ|46943368|0.01   ...
    3|10| 4|GAZ|STK||0.0||ISE     |USD|GAZ|GAZ|GAZ|46943368|0.01   ...
    3|10| 4|GAZ|STK||0.0||ISLAND  |USD|GAZ|GAZ|GAZ|46943368|0.01   ...
    3|10| 4|GAZ|STK||0.0||LAVA    |USD|GAZ|GAZ|GAZ|46943368|0.01   ...
    3|10| 4|GAZ|STK||0.0||NSX     |USD|GAZ|GAZ|GAZ|46943368|0.01   ...
    3|10| 4|GAZ|STK||0.0||TRACKECN|USD|GAZ|GAZ|GAZ|46943368|0.01   ...

In particular, I don't see a ib contract 35052259.  Presumably you
and I have different accounts, and the api filters contract details

For your other symbols, would you be willing to consider using
wild-card contract details queries to determine the correct entries
to the database load files, and submitting patches to the list?

For that matter, for proprietary trading, you can make these changes
locally and not even say anything.  The reason to submit changes
to the list is just for your convenience, so that new releases
capture your earlier updates.

To make such changes, you could edit the load files, and then
run the database create.sql script to drop, recreate, and repopulate

Please post to the list if you have questions about any of the above



-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.trading-shim.org/pipermail/ts-general/attachments/20080908/b5e4f8be/attachment.html 

More information about the ts-general mailing list