python-Day7
学习要有定位,明确目标地去学习。希望自己能坚持下去,并有所收获---leaves(ps月初有事耽误计划了,进度落后计划蛮多了,算了。不多想,复习，学会才是硬道理,坚持fighting！)
python06 -- python的pickle模块以及mysql数据库初始用
一、python的pickle模块
1.1 pickle模块的作用
pickle是为了序列化/反序列化数据的,可以把数据持久化存储。eg:你有些数据想下次运行程序的时候直接使用,或者想把数据传给网络上的其他程序,就可以使用pickle打包,那边的python程序用pickle反序列化就可以了。
1.2 pickle模块的所有函数
In [32]: import pickle In [33]: dir(pickle)Out[33]: 'classmap', 'compatible_formats', 'decode_long', 'dispatch_table', 'dump', 'dumps', 'encode_long', 'format_version', 'load', 'loads', 'marshal', 'mloads', 're', 'struct', 'sys', 'whichmodule']
1.3 pickle的常用方法
1.pickle.dump("数据",文件名) 把字典转为二进制
2.pickle.load("文件名") 把二进制转为字典
##pickle代码小练习
In [32]: import pickle In [37]: users = {'AA': 'we231', 'Xman': '123', 'tt': '123', 'woniu': '21'}In [39]: fo = open("test.txt",'wb')In [42]: fo = open("test.txt",'wb')In [43]: pickle.dump(users,fo) #数据---> 文件In [44]: fo.close()##查看test.txt文件内容[root@test ketang]# cat test.txt (dp0S'AA'p1S'we231'p2sS'Xman'p3S'123'p4sS'tt'p5g4sS'woniu'p6S'21'p7s.[root@test ketang]#In [9]: fi = open('test.txt','rb+')In [10]: print pickle.load(fi){'AA': 'we231', 'Xman': '123', 'tt': '123', 'woniu': '21'} 1.4 通过pickle实现用户的增删改查
#/usr/local/python#coding:utf-8''' ##使用pickle实现对users.txt文件中用户密码的增、删、改、查功能(具体见github06/pickle代码)'''from pickle import dump ,load#定义全局变量filename,用于测试filename = 'users.txt'##注意事先要将users写入到users.txt文件中(此处在1.3中ipython的环境中操作过了)users = {'AA': 'AA123', 'Xman': '123', 'tt': '123', 'woniu': '21', 'KK': 'k123'}#获取所有用户名密码,从filename文件中读取def getUsers(): with open(filename,'rb') as readf: res = load(readf) return res#添加用户def addUser(name,password): tmp = getUsers() if (not name) or (not password): errmsg = "Wrong name or password" return errmsg if (name in tmp): errmsg = "name is exists" return errmsg tmp[name] = password msg = "%s:%s ---->adding" %(name,password) with open(filename,'wb') as updatef: dump(tmp,updatef) return msg ##更改用户def updateUser(name,password): tmp = getUsers() if name not in tmp: errmsg = 'The update username is not exist' return errmsg msg = "Update %s:%s ---->%s" %(tmp[name],password,name) tmp[name] = password with open(filename,'wb') as updatef: dump(tmp,updatef) return msg#删除用户def deleteUser(name): tmp = getUsers() if name not in tmp: errmsg = 'The delete username is not exist' return errmsg msg = "Delete %s ---->%s" %('users.txt',name) tmp.pop(name) with open(filename,'wb') as updatef: dump(tmp,updatef) return msg##查找用户名对应的密码def findUser(name): tmp = getUsers() if name not in tmp : errmsg = "The username is not exists" return errmsg return tmp[name]##主程序入口if __name__ == "__main__": print getUsers() print findUser('') print findUser('AA') print "add user %s" % ('*' * 40) print addUser('pc','pc123') print addUser('TT','') print addUser('','pc123') print addUser('AA','pc123') print "update user %s" % ('*' * 40) print updateUser('AA1','123') print updateUser('AA','AA123') print "delete user %s" % ('*' * 40) print deleteUser('AA1') print deleteUser('pc') 二、MySQL存储数据
2.1 安装mysql以及mysql扩展
yum install -y mysql mysql-server ##安装完成后设置开机启动以及数据库密码[root@test mysqlData]# chkconfig --level 1234 mysqld on #设置开机启动[root@test mysqlData]# chkconfig --list mysqld mysqld 0:off 1:on 2:on 3:on 4:on 5:on 6:off[root@test mysqlData]# # /etc/init.d/mysqld start 启动数据库#[root@test mysqlData]# [root@test mysqlData]# netstat -ntpl ##查看数据库运行状态Active Internet connections (only servers)Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 127.0.0.1:2208 0.0.0.0:* LISTEN 3014/hpiod tcp 0 0 127.0.0.1:199 0.0.0.0:* LISTEN 3032/snmpd tcp 0 0 0.0.0.0:3306 0.0.0.0:* LISTEN 3416/mysqld tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN 2667/portmap tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 3102/httpd tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 3052/sshd tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 3068/cupsd tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN 3472/sendmail: acce tcp 0 0 0.0.0.0:766 0.0.0.0:* LISTEN 2704/rpc.statd [root@test mysqlData]# ##设置数据库密码##mysqladmin -u 用户名 -p"密码" password 新密码 ===>回车后输入旧密码刚安装数据库的话第一次设置密码命令## mysqladmin -uroot password "123456"##mysql扩展安装1.yum install python-pip2. pip install MySQL-python##安装完成后的检查(在ipython中import MySQLdb as mysql 无报错信息则成功)In [1]: import MySQLdb as mysqlIn [2]:
2.2 数据库的简单操作
##创建库mysql> create database reboot; #创建库Query OK, 1 row affected (0.01 sec)mysql> show databases; #列出所有库+--------------------+| Database |+--------------------+| information_schema || mysql || performance_schema || reboot || reboot10 || test |+--------------------+6 rows in set (0.00 sec)mysql> use reboot; #切换库,使用reboot库Database changed#创建表mysql> create table users( -> id int AUTO_INCREMENT primary key -> ,name varchar(20) not null comment '用户名' -> ,name_cn varchar(50) not null comment '中文名' -> ,password varchar(50) not null comment '用户密码' -> ,email varchar(50) comment '电子邮件' -> ,mobile varchar(11) not null comment '手机号码' -> ,role varchar(10) not null comment '1:sa;2:php;3:ios;4:test' -> ,status tinyint -> ,create_time datetime comment '创建时间' -> ,last_time datetime comment '最后登录时间' -> ,unique key name (name) ) engine=innodb comment '用户表';Query OK, 0 rows affected (0.06 sec)mysql> desc users; #查看表信息,表中字段定义及类型+-------------+-------------+------+-----+---------+----------------+| Field | Type | Null | Key | Default | Extra |+-------------+-------------+------+-----+---------+----------------+| id | int(11) | NO | PRI | NULL | auto_increment || name | varchar(20) | NO | UNI | NULL | || name_cn | varchar(50) | NO | | NULL | || password | varchar(50) | NO | | NULL | || email | varchar(50) | YES | | NULL | || mobile | varchar(11) | NO | | NULL | || role | varchar(10) | NO | | NULL | || status | tinyint(4) | YES | | NULL | || create_time | datetime | YES | | NULL | || last_time | datetime | YES | | NULL | |+-------------+-------------+------+-----+---------+----------------+10 rows in set (0.00 sec)mysql> show tables; #查看库中有哪些表+------------------+| Tables_in_reboot |+------------------+| users |+------------------+1 row in set (0.00 sec)mysql>##mysql数据库中插入数据mysql> insert into users (name,name_cn,password,email,mobile,role,status,create_time) values ('ss','ss','ss123 ','ss@chinacache.com','ssss','user','0','2016-11-30 15:37:48');Query OK, 1 row affected (0.02 sec)mysql> mysql> select * from users; #查找表中所有数据+----+------+---------+----------+-------------------+--------+------+--------+---------------------+-----------+| id | name | name_cn | password | email | mobile | role | status | create_time | last_time |+----+------+---------+----------+-------------------+--------+------+--------+---------------------+-----------+| 1 | ss | ss | ss123 | ss@chinacache.com | ssss | user | 0 | 2016-11-30 15:37:48 | NULL |+----+------+---------+----------+-------------------+--------+------+--------+---------------------+-----------+1 row in set (0.00 sec) 2.3 python交互环境下对mysql的操作
##导入数据库In [8]: import MySQLdb as mysql##连接数据库In [9]: data = mysql.connect(user='root',passwd='123456',db='reboot',charset='utf8')##建立游标,添加这行后数据库就初始化完成In [10]: cur = data.cursor()In [11]: data.autocommit(True) ##设置自动提交，比较重要##在ipython端添加数据#在ipython段查询所有数据In [13]: cur.execute('select * from users')Out[13]: 1LIn [14]: import datetime #导入datetimeIn [15]: ##datetime模块可以实现在数据库中create_time生成时间In [16]: sql = "insert into users(name,name_cn,password,email,mobile,role,status,create_time) values ('cc' ...: ,'cc','cC23 ','CC@chinacache.com','CCC','user','0','%s') " %(datetime.datetime.now().strftime("%Y ...: -%m-%d %H:%M:%S"))In [17]: print sqlinsert into users(name,name_cn,password,email,mobile,role,status,create_time) values ('cc','cc','cC23 ','CC@chinacache.com','CCC','user','0','2016-11-30 16:04:33') In [18]: cur.execute(sql)Out[18]: 1L#再次查询所有数据发现新增加了一条数据In [19]: cur.execute("select * from users;")Out[19]: 2L##在mysql段查询所有数据确认新增数据mysql> select * from users;+----+------+---------+----------+-------------------+--------+------+--------+---------------------+-----------+| id | name | name_cn | password | email | mobile | role | status | create_time | last_time |+----+------+---------+----------+-------------------+--------+------+--------+---------------------+-----------+| 1 | ss | ss | ss123 | ss@chinacache.com | ssss | user | 0 | 2016-11-30 15:37:48 | NULL || 2 | cc | cc | cC23 | CC@chinacache.com | CCC | user | 0 | 2016-11-30 16:04:33 | NULL |+----+------+---------+----------+-------------------+--------+------+--------+---------------------+-----------+2 rows in set (0.00 sec)mysql> ##ipython交互下查找数据###查询所有数据In [20]: select_sql = "select name,name_cn,password,email,mobile,role,status,create_time from users"In [21]: cur.execute(select_sql)Out[21]: 2LIn [22]: res = cur.fetchall() ##查找所有数据使用cur.fetchall(),单条数据则使用cur.fetchone()In [23]: print res((u'ss', u'ss', u'ss123 ', u'ss@chinacache.com', u'ssss', u'user', 0, datetime.datetime(2016, 11, 30, 15, 37, 48)), (u'cc', u'cc', u'cC23 ', u'CC@chinacache.com', u'CCC', u'user', 0, datetime.datetime(2016, 11, 30, 16, 4, 33)))###查询单条数据In [24]: select_sql = "select name,name_cn,password,email,mobile,role,status,create_time from users where ...: name = 'ss'"In [25]: cur.execute(select_sql)Out[25]: 1LIn [26]: res = cur.fetchone()In [27]: print res(u'ss', u'ss', u'ss123 ', u'ss@chinacache.com', u'ssss', u'user', 0, datetime.datetime(2016, 11, 30, 15, 37, 48))In [28]: ###ipython交互模式下查询所有数据以及将数据重组成我们想要的形式In [36]: select_sql = "select name,name_cn,password,email,mobile,role,status,create_time from users "In [37]: cur.execute(select_sql)Out[37]: 4LIn [38]: res = cur.fetchall()In [39]: print res((u'ss', u'ss', u'ss123 ', u'ss@chinacache.com', u'ssss', u'user', 0, datetime.datetime(2016, 11, 30, 15, 37, 48)), (u'cc', u'cc', u'cC23 ', u'CC@chinacache.com', u'CCC', u'user', 0, datetime.datetime(2016, 11, 30, 16, 4, 33)), (u'admin', u'admin', u'admin ', u'admin@cc.com', u'admin', u'admin', 0, datetime.datetime(2016, 11, 30, 16, 25, 17)), (u'TT', u'TT', u'tt123 ', u'tt@cc.com', u'123223', u'sa', 0, datetime.datetime(2016, 11, 30, 16, 26, 17)))##思考：如何将上述res更改成为我们想要的字典形式In [40]: fields = ['name','name_cn','password','email','mobile','role','status','create_time']原生实现方式：In [7]: select_sql = "select %s from users" %','.join(fields)In [8]: print select_sqlselect name,name_cn,password,email,mobile,role,status,create_time from usersIn [9]: cur.execute(select_sql)Out[9]: 4LIn [10]: res = cur.fetchall()In [11]: resOut[11]: ((u'ss', u'ss', u'ss123 ', u'ss@chinacache.com', u'ssss', u'user', 0, datetime.datetime(2016, 11, 30, 15, 37, 48)), (u'cc', u'cc', u'cC23 ', u'CC@chinacache.com', u'CCC', u'user', 0, datetime.datetime(2016, 11, 30, 16, 4, 33)), (u'admin', u'admin', u'admin ', u'admin@cc.com', u'admin', u'admin', 0, datetime.datetime(2016, 11, 30, 16, 25, 17)), (u'TT', u'TT', u'tt123 ', u'tt@cc.com', u'123223', u'sa', 0, datetime.datetime(2016, 11, 30, 16, 26, 17)))In [12]: users = [] In [13]: for row in res : ...: user = {} ...: for k ,v in enumerate(fields): ...: user[v] = row[k] ...: users.append(user) ...: In [14]: usersOut[14]: [{'create_time': datetime.datetime(2016, 11, 30, 15, 37, 48), 'email': u'ss@chinacache.com', 'mobile': u'ssss', 'name': u'ss', 'name_cn': u'ss', 'password': u'ss123 ', 'role': u'user', 'status': 0}, {'create_time': datetime.datetime(2016, 11, 30, 16, 4, 33), 'email': u'CC@chinacache.com', 'mobile': u'CCC', 'name': u'cc', 'name_cn': u'cc', 'password': u'cC23 ', 'role': u'user', 'status': 0}, {'create_time': datetime.datetime(2016, 11, 30, 16, 25, 17), 'email': u'admin@cc.com', 'mobile': u'admin', 'name': u'admin', 'name_cn': u'admin', 'password': u'admin ', 'role': u'admin', 'status': 0}, {'create_time': datetime.datetime(2016, 11, 30, 16, 26, 17), 'email': u'tt@cc.com', 'mobile': u'123223', 'name': u'TT', 'name_cn': u'TT', 'password': u'tt123 ', 'role': u'sa', 'status': 0}]In [15]: ###高阶的进阶方式代码(字典生成式 + 列表生成式 一行搞定)In [45]: users = [dict((v,row[k]) for k ,v in enumerate(fields)) for row in res ]###关闭游标和数据库In [15]: cur.close()In [16]: data.close() 2.4 自己感悟的数据库操作
2.4.1 高阶用法记录 【字典生成式 + 列表生成式 简化代码】
如下面代码可用 users = [ dict((v,row[k]) for k ,v in enumerate(fields)) for row in res ]
In [12]: users = []In [13]: for row in res : ...: user = {} ...: for k ,v in enumerate(fields): ...: user[v] = row[k] ...: users.append(user) ...: 2.4.2 python搭建一个临时的下载服务器;
python -m SimpleHTTPServer(默认会解析当前目录下的html文件)
三、总结
python数据库操作流程
1.导入mysql扩展模块, import MySQLdb as mysql
2.链接数据库 db = mysql.connect(各种参数)
3.建立游标, cur = db.cursor() ,自此数据库初始化完成,可以干活了
4.编写mysql的语句(增删改查) sql = "*****"
5.执行sql语句 cur.execute(sql) db.commit() ===>数据提交
6.查询 分为两种 (在mysql中查询 select * from users)
1.查询单条记录, cur.fetchone()
2.查询多条记录 cur.fetchall()
7.注意此时,在mysql中查看数据还是未更新的，需要关闭游标
db.commit() ===>数据提交
将内存中的数据存储到数据库的表上。
mysql设置为默认自动提交 show variables like 'autocommit%';
或者添加db.autocommit(True) 设置交互端自动提交数据
8.关闭游标和数据库
cur.close()
conn.close()