My proposed talk titled Develop for an international audience got selected for Pycon India, 2012. It’s time to start working on the slides. I am thinking to use rst to write my slides. Also, I have booked by flight tickets for Pycon 🙂
Thanks everyone who voted for my talk.
Transifex already supported validating translations of old styled Python strings, e.g.,
"A sample string with a %(keyword)s argument." % {'keyword': 'key word'}
The validation is done by checking if all the positional and keyword arguments are present in the translation string and the translation string does not contain any extra argument which is not in the source string. You can have a look at the validator code here.
However, the existing validator is not able to check for replacement fields in new style Python format strings, e.g.
"This is a sample string with different replacement fields: {} {1} {foo["bar"]:^30}".format(
"arg0", "arg1", foo={"bar":"a kwarg"})
I tried to devise a regex to extract the replacement fields in the Python format string based on the grammar defined here.
# Regex to find format specifiers in a Python string
import re
field_name = '(?P<field_name>(?P<arg_name>\w+|\d+){0,1}'\
'(?:(?P<attribute_name>\.\w+)|'\
'(?P<element_index>\[(?:\d+|(?:[^\]]+))\]))*)'
conversion = '(?P<conversion>r|s)'
align = '(?:(?P<fill>[^}{]?)(?P<align>[<>^=]))'
sign = '(?P<sign>[\+\- ])'
width = '(?P<width>\d+)'
precision = '(?P<precision>\d+)'
type_ = '(?P<type_>[bcdeEfFgGnosxX%])'
format_spec = ''\
'(?P<format_spec>'\
'%(align)s{0,1}'\
'%(sign)s{0,1}#?0?'\
'%(width)s{0,1},?'\
'(?:\.%(precision)s){0,1}'\
'%(type)s{0,1}'\
')' % {
'align': align,
'sign': sign,
'width': width,
'precision': precision,
'type': type_
}
replacement_field = ''\
'\{'\
'(?:'\
'%(field_name)s{0,1}'\
'(?:!%(conversion)s){0,1}'\
'(?:\:%(format_spec)s){0,1}'\
')'\
'\}' % {
'field_name': field_name,
'conversion': conversion,
'format_spec': format_spec
}
printf_re = re.compile(
'(?:' + replacement_field + '|'
'%((?:(?P<ord>\d+)\$|\((?P<key>\w+)\))?(?P<fullvar>[+#-]*(?:\d+)?'
'(?:\.\d+)?(hh\|h\|l\|ll)?(?P<type>[\w%])))'
')'
)
Well, with the above, I was able to parse almost all the cases discussed here except for this one:
import datetime
d = datetime.datetime(2010, 7, 4, 12, 15, 58)
s = '{:%Y-%m-%d %H:%M:%S}'.format(d)
I was not sure how I could fit the above case to my regex. After some discussions in #python on IRC, I found some limitations of regular expressions and that it is not Turing complete. People suggested me to use some parser tools.
I, being a strong supporter of “Never re invent the wheel”, gave another shot to find some existing solution and lucky I was to come across _formatter_parser() of a Python string object. It correctly found all replacement fields in python format strings properly and returned an iterable of tuples (literal_text, field_name, format_spec, conversion). All I needed then was to convert this info to a list of replacement fields in a format string. A simple script below would is all that I needed to extract replacement fields in a format string in Python:
replacement_fields = []
s = "{foo:^+30f} bar {0} foo {} {time:%Y-%m-%d %H:%M:%S}"
for literal_text, field_name, format_spec, conversion in \
s._formatter_parser():
if field_name is not None:
replacement_field = field_name
if conversion is not None:
replacement_field += '!' + conversion
if format_spec:
replacement_field += ':' + format_spec
replacement_field = '{' + replacement_field + '}'
replacement_fields.append(replacement_field)
print replacement_fields
["{foo:^+30f}", "{0}", "{}", "{time:%Y-%m-%d %H:%M:%S}"]
That’s all. Simple and easy, isn’t it?
It’s more than a year now that I have been working at Transifex. It’s a great experience to be a part of the Transifex team. Well, it’s been a roller coaster ride for me at Transifex. I had to go through steep learning curves, work with new stuffs, deliver great features, meet strict deadlines. It was fun, because of being part of an awesome team. I am very much thankful to Apostolis, Konstantinos, John and Diego for guiding me and helping me.
During the course of this journey, I have made many friends. It’s always great to speak with the OpenTranslators folk. They all rock. I am also very much thankful to Youversion, Eventbrite, Pinterest, Dropbox folks for their queries and feedback. It makes me happy to help resolve issues with Transifex and add new features for our users. It gives me a sense of satisfaction that I am able to play my part for the greater good.
Mozilla has always fascinated me since a long time. I love Mozilla, it’s logos, it’s products and it’s goals. At Transifex, I worked on developing new API features to support Pontoon use Transifex as a backend. Following this, I also got involved with Pontoon’s development and have made a few commits. Finally, I contributed in some way to a Mozilla project.
A long road lies ahead. I hope it to be full of new challenges and excitement.
@rtnpro writes... 